00000001:02000400:0.0F:1788839387.333354:0:3290:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788839396.421482:0:3492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788839397.484014:0:3554:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1287 MB/s 00000001:01000000:2.0:1788839397.733834:0:3554:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1623 MB/s 00000001:01000000:2.0:1788839397.983818:0:3554:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10031 MB/s 00000020:02000000:1.0F:1788839398.275531:0:3583:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_115_g0321d60 00000400:02000000:3.0:1788839398.654763:0:3598:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.152@tcp [8/256/0/180] 00008000:02000000:0.0:1788839401.077329:0:3748:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788839463.532466:0:5714:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788839475.878736:0:6464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788839475.878741:0:6464:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788839475.878743:0:6464:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788839475.878945:0:6464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000226e8568 00000080:02000400:2.0:1788839475.878955:0:6464:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788839475.881837:0:6464:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788839475.881851:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788839475.881879:0:6464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000068fd98e6) 00000020:00000080:2.0:1788839475.881900:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839475.990072:0:6464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788839475.990183:0:6464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788839476.029346:0:6464:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788839476.029722:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788839476.029732:0:6464:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839476.029745:0:6464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26572613 00000020:01000004:3.0:1788839476.029752:0:6464:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788839476.029757:0:6464:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788839476.029761:0:6464:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000226e8568 from MGS 00000020:01000004:3.0:1788839476.029765:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788839476.029977:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000025079d61) 00000020:00000080:3.0:1788839476.029991:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788839476.030108:0:6464:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000226e8568 from MGS, refs=2 00080000:01000000:3.0:1788839476.030113:0:6464:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788839476.030120:0:6464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26572621 00000100:00100000:3.0:1788839476.030570:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788839476.031058:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788839476.031066:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788839476.031747:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788839476.031755:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788839476.033375:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839476.033986:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788839476.033993:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788839476.034605:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788839476.034612:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788839476.035200:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788839476.035215:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788839476.036093:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839476.036097:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839476.036098:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839476.036456:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839476.036459:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839476.036460:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839476.041047:0:6464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788839476.045897:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788839476.290847:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3163 MB/s 00000001:01000000:0.0:1788839476.540807:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3651 MB/s 00000001:01000000:0.0:1788839476.791690:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 639 MB/s 00000001:01000000:3.0:1788839477.041327:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1123 MB/s 00080000:10000000:2.0:1788839477.050958:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:1.0:1788839477.056795:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788839477.062694:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788839477.063447:0:6478:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788839477.063507:0:6464:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788839477.063540:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788839477.063683:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788839477.063706:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788839477.064077:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839477.064278:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788839477.064284:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788839477.067527:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788839477.067539:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788839477.068050:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788839477.068057:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788839477.068567:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788839477.068589:0:6464:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:1.0:1788839477.068591:0:6464:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788839477.068653:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:1.0:1788839477.068673:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (00000000fcbde265) 00000020:00000080:1.0:1788839477.068690:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788839477.068819:0:6464:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000095914bc6@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839477.068986:0:6464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:1.0:1788839477.068993:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788839477.069705:0:6482:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788839477.074962:0:6483:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788839477.075066:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid 096dcd45-3d06-4359-b81b-4bde04036a06) 00000020:00000080:1.0:1788839477.075089:0:6464:0:(genops.c:1385:class_connect()) connect: client 096dcd45-3d06-4359-b81b-4bde04036a06, cookie 0xad5b343a2657262f 00000100:00080000:1.0:1788839477.075101:0:6464:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839477.075107:0:6464:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import 0000000095914bc6 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839477.075152:0:6464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002612d033 x1875734060597376/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839477.075180:0:6464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 096dcd45-3d06-4359-b81b-4bde04036a06->MGS 00000020:01000004:1.0:1788839477.075207:0:6464:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788839477.075227:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788839477.075246:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000f392546b) 00000020:00000080:1.0:1788839477.075266:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788839477.076883:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002612d033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060597376:0@lo:250: 00000100:00100000:2.0:1788839477.076963:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839477.077040:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060597376 00000100:00100000:2.0:1788839477.077047:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060597376 00000100:00100000:2.0:1788839477.077082:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839477.077088:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021941c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875734060597376:12345-0@lo:250: 00010000:00080000:2.0:1788839477.077110:0:6479:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 096dcd45-3d06-4359-b81b-4bde04036a06@0@lo t0 exp 0000000000000000 cur 132 last 0 00000020:00000080:2.0:1788839477.077138:0:6479:0:(genops.c:1385:class_connect()) connect: client 096dcd45-3d06-4359-b81b-4bde04036a06, cookie 0xad5b343a2657263d 00000100:00080000:2.0:1788839477.077900:0:6479:0:(import.c:65:import_set_state_nolock()) 00000000ebdd60f3 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839477.078003:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021941c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+5:3613:x1875734060597376:12345-0@lo:250: Request processed in 913us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.078012:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839477.095123:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788839477.095140:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:3.0:1788839477.095149:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788839477.095155:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788839477.095158:0:3613:0:(import.c:65:import_set_state_nolock()) 0000000095914bc6 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788839477.095174:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788839477.095192:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788839477.095208:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002612d033 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060597376:0@lo:250: 00000100:00100000:1.0:1788839477.115044:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839477.115324:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839477.115331:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788839477.117191:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788839477.117212:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788839477.117985:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839477.117993:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788839477.119171:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839477.119429:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788839477.119435:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788839477.123082:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788839477.123093:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788839477.178294:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839477.178997:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788839477.179003:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788839477.180398:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788839477.180409:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788839477.181494:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839477.181716:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839477.181722:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788839477.185274:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788839477.185291:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788839477.186223:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839477.186468:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839477.186473:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788839477.187517:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839477.187526:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788839477.190163:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839477.190413:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839477.190421:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788839477.193172:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839477.193185:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788839477.215222:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788839477.215720:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788839477.215726:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788839477.217437:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788839477.217448:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788839477.218341:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839477.218349:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788839477.219269:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788839477.219301:0:6464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788839477.219309:0:6464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788839477.219420:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839477.219454:0:6464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788839477.219458:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839477.219459:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839477.219461:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839477.219462:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839477.219463:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839477.219464:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839477.219465:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839477.219467:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839477.219468:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839477.219469:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839477.219471:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839477.219477:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839477.219479:0:6464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788839477.219481:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839477.219482:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839477.219483:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839477.219484:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839477.219484:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839477.219485:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839477.219486:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839477.219487:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839477.219488:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839477.219489:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839477.219490:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839477.219490:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839477.219528:0:6464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788839477.219551:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597504:0@lo:253: 00000100:00100000:3.0:1788839477.219633:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.219686:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f602408d going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.219694:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060597504 00000100:00100000:2.0:1788839477.219701:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060597504 00000100:00100000:2.0:1788839477.219753:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839477.219760:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e7bddd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+5:6464:x1875734060597504:12345-0@lo:253: 20000000:01000000:2.0:1788839477.219904:0:6481:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788839477.219908:0:6481:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788839477.221253:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788839477.221309:0:6481:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788839477.221620:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839477.223480:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788839477.224282:0:6481:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788839477.224287:0:6481:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788839477.224294:0:6481:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788839477.224297:0:6481:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788839477.224309:0:6481:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788839477.224501:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839477.224991:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788839477.225007:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788839477.225026:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788839477.225042:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788839477.225057:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788839477.225114:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788839477.225121:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788839477.225134:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788839477.225139:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788839477.225150:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788839477.225155:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788839477.225167:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788839477.225192:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788839477.225230:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788839477.225235:0:6481:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788839477.225242:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839477.225333:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788839477.225342:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788839477.225357:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788839477.225372:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788839477.225403:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788839477.225413:0:6481:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788839477.225437:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788839477.225444:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788839477.225456:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788839477.225471:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788839477.225484:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788839477.225491:0:6481:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788839477.225510:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788839477.225516:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788839477.225528:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788839477.225542:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788839477.225661:0:6481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788839477.225736:0:6481:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788839477.225743:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788839477.226332:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788839477.226538:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788839477.226560:0:6481:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:2.0:1788839477.226561:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1788839477.226574:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788839477.226579:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788839477.227422:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788839477.227439:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1788839477.227469:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788839477.227477:0:6481:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788839477.227505:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788839477.227523:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788839477.227558:0:6481:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788839477.227561:0:6481:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788839477.227565:0:6481:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788839477.227677:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788839477.227744:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788839477.228293:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788839477.228477:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788839477.228501:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788839477.228535:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788839477.228547:0:6481:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788839477.228548:0:6481:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788839477.230467:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788839477.231059:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788839477.231088:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788839477.231103:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788839477.231114:0:6481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839477.231117:0:6481:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788839477.231121:0:6481:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788839477.231124:0:6481:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788839477.231129:0:6481:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788839477.231135:0:6481:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788839477.231929:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788839477.232105:0:6481:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788839477.244427:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788839477.244518:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788839477.244530:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788839477.244550:0:6481:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788839477.244572:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244588:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244597:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244602:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244618:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244623:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244628:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008be9d29f already unused, calling callback (0000000057ea3cd3) 00010000:00010000:3.0:1788839477.244632:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244639:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244652:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244658:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.244663:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008be9d29f/0xad5b343a26572644 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788839477.244681:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788839477.286725:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e7bddd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+5:6464:x1875734060597504:12345-0@lo:253: Request processed in 66954us (67081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839477.286748:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839477.286941:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597504:0@lo:253: 10000000:01000000:3.0:1788839477.286959:0:6464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788839477.286962:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839477.286964:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839477.286966:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839477.286967:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788839477.286969:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839477.286978:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839477.286980:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839477.286981:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839477.286982:0:6464:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788839477.286983:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839477.286985:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839477.287005:0:6464:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000226e8568 from lustre-MDT0000 10000000:01000000:3.0:1788839477.287036:0:6464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788839477.287038:0:6464:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788839477.287042:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab7486e8000 10000000:01000000:3.0:1788839477.287047:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839477.287055:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab7486e8000 from 1 10000000:01000000:3.0:1788839477.287057:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839477.287349:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.287361:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.287369:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.287388:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597632:0@lo:101: 00000100:00100000:3.0:1788839477.287441:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.287502:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000feb741a4 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.287575:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060597632 00000100:00100000:2.0:1788839477.287582:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060597632 00000100:00100000:2.0:1788839477.287631:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839477.287639:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db219647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6464:x1875734060597632:12345-0@lo:101: 00010000:00010000:2.0:1788839477.287651:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839477.287666:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657264b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.287699:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657264b expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.287708:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657264b expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.287719:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdb49716, rc 0) 00000100:00100000:2.0:1788839477.287760:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db219647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+6:6464:x1875734060597632:12345-0@lo:101: Request processed in 123us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.287766:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839477.288043:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597632:0@lo:101: 00010000:00010000:1.0:1788839477.288057:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.288294:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839477.288367:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7e3ee27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597760:0@lo:501: 00000100:00100000:1.0:1788839477.288411:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.288480:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca573eee going to sleep for 11 seconds 00000100:00100000:0.0:1788839477.288525:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060597760 00000100:00100000:0.0:1788839477.288530:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060597760 00000100:00100000:0.0:1788839477.288614:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839477.288621:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013a381bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+6:6464:x1875734060597760:12345-0@lo:501: 00000100:00100000:0.0:1788839477.288719:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013a381bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+6:6464:x1875734060597760:12345-0@lo:501: Request processed in 99us (308us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839477.288726:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839477.288801:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7e3ee27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597760:0@lo:501: 10000000:01000000:1.0:1788839477.288830:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788839477.288850:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.288857:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839477.288866:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab745341000 10000000:01000000:1.0:1788839477.288870:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839477.288874:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab745341000 10000000:01000000:1.0:1788839477.288876:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788839477.288879:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab745341000 from 1 10000000:01000000:1.0:1788839477.288881:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788839477.288899:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.288905:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.288912:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839477.288922:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7e3ee27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597888:0@lo:101: 00000100:00100000:1.0:1788839477.288946:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.290531:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca573eee going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.291597:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060597888 00000100:00100000:2.0:1788839477.291608:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060597888 00000100:00100000:1.0:1788839477.291729:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839477.291754:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1e07576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+6:6464:x1875734060597888:12345-0@lo:101: 00010000:00010000:1.0:1788839477.291800:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839477.291818:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000519f8c7a/0xad5b343a26572660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572659 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.291845:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000519f8c7a/0xad5b343a26572660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572659 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.291855:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000519f8c7a/0xad5b343a26572660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572659 expref: 7 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.291864:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000519f8c7a, rc 0) 00000100:00100000:1.0:1788839477.291938:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1e07576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+7:6464:x1875734060597888:12345-0@lo:101: Request processed in 187us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.291945:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839477.292710:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7e3ee27 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060597888:0@lo:101: 00010000:00010000:3.0:1788839477.292732:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.292743:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839477.292863:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788839477.292882:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.292889:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000000861a857/0xad5b343a26572659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839477.292897:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788839477.292902:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839477.292908:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab745341000 10000000:01000000:3.0:1788839477.292911:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788839477.292914:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788839477.292917:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839477.292946:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.292953:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.292960:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.292979:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598016:0@lo:101: 00000100:00100000:3.0:1788839477.293024:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839477.293426:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598016 00000100:00100000:0.0:1788839477.293434:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598016 00000100:00100000:0.0:1788839477.293484:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839477.293492:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faf80843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+7:6464:x1875734060598016:12345-0@lo:101: 00010000:00010000:0.0:1788839477.293504:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839477.293521:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572667 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.293540:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572667 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.293562:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572667 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.293570:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000db4641e, rc 0) 00000100:00100000:0.0:1788839477.293600:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faf80843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+8:6464:x1875734060598016:12345-0@lo:101: Request processed in 110us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839477.293606:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839477.294493:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fbf138f going to sleep for 11 seconds 00000100:00100000:3.0:1788839477.294521:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598016:0@lo:101: 00010000:00010000:3.0:1788839477.294536:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.294559:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.294627:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598144:0@lo:501: 00000100:00100000:3.0:1788839477.294661:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.294692:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fbf138f going to sleep for 11 seconds 00000100:00100000:1.0:1788839477.294754:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598144 00000100:00100000:1.0:1788839477.294759:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598144 00000100:00100000:1.0:1788839477.294812:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839477.294818:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001914b9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+8:6464:x1875734060598144:12345-0@lo:501: 00000100:00100000:1.0:1788839477.294934:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001914b9c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+9:6464:x1875734060598144:12345-0@lo:501: Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.294941:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839477.297652:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598144:0@lo:501: 00000100:00100000:3.0:1788839477.297741:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598272:0@lo:503: 00000100:00100000:3.0:1788839477.298021:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.298382:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598272 00000100:00100000:1.0:1788839477.298390:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598272 00000100:00100000:1.0:1788839477.298445:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788839477.298453:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aa0b7a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+9:6464:x1875734060598272:12345-0@lo:503: 00000100:00100000:1.0:1788839477.298569:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aa0b7a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+9:6464:x1875734060598272:12345-0@lo:503: Request processed in 116us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.298585:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839477.298670:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000006fbf138f going to sleep for 11 seconds 00000100:00100000:3.0:1788839477.298686:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598272:0@lo:503: 00000100:00100000:2.0:1788839477.300404:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6509:1875734060598400:0@lo:502: 00000100:00100000:2.0:1788839477.300470:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839477.300583:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e0ff8d41 going to sleep for 11 seconds 00000100:00100000:0.0:1788839477.300631:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598400 00000100:00100000:0.0:1788839477.300638:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598400 00000100:00100000:0.0:1788839477.300725:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839477.300734:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048b7177a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+9:6509:x1875734060598400:12345-0@lo:502: 00000100:00100000:0.0:1788839477.300970:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048b7177a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+9:6509:x1875734060598400:12345-0@lo:502: Request processed in 237us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839477.300978:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839477.301316:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6509:1875734060598400:0@lo:502: 00000020:01000000:2.0:1788839477.301346:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839477.301359:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839477.301362:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788839477.301367:0:6509:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788839477.301370:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839477.301386:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000395e8f3e) 00000020:00000080:2.0:1788839477.301405:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788839477.301411:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788839477.301505:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788839477.301513:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a2657267c 00000020:00000080:2.0:1788839477.301753:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788839477.301758:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839477.301766:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839477.301797:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788839477.301802:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839477.301806:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839477.301807:0:6509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788839477.301811:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839477.301819:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e37c9204) 00000020:00000080:2.0:1788839477.301829:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788839477.301832:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788839477.301834:0:6509:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788839477.301837:0:6509:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788839477.301843:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839477.301880:0:6509:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000226e8568 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788839477.301893:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008463f175) 00000020:00000080:2.0:1788839477.301899:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788839477.301956:0:6509:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788839477.301962:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26572691 00000020:00000080:2.0:1788839477.302043:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788839477.302050:0:6509:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788839477.302054:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad5b343a26572698 00080000:01000000:2.0:1788839477.302071:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788839477.302076:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a2657269f 00080000:10000000:2.0:1788839477.305631:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788839477.305899:0:6509:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788839477.314153:0:6509:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788839477.399347:0:6509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788839477.399912:0:6509:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788839477.401549:0:6509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788839477.402306:0:6509:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788839477.406410:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000027cff59b) 00000020:00000080:3.0:1788839477.406438:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788839477.406530:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788839477.406538:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a265726ad 00000020:00000080:3.0:1788839477.407357:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788839477.408316:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.410807:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.414823:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.417492:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.420425:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.422056:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788839477.423446:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad5b343a265726b4 00000020:00000080:3.0:1788839477.425563:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788839477.425576:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839477.425584:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839477.425587:0:6509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788839477.425593:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839477.425598:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839477.425599:0:6509:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839477.425603:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839477.425605:0:6509:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839477.425608:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839477.425611:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839477.425612:0:6509:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788839477.425614:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839477.425619:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839477.425620:0:6509:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788839477.425625:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788839477.425678:0:6509:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788839477.425830:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6509:1875734060598528:0@lo:502: 00000100:00100000:3.0:1788839477.425926:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.426039:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000001657535b going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.426333:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598528 00000100:00100000:2.0:1788839477.426340:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598528 00000100:00100000:2.0:1788839477.426422:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839477.426430:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cab2b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+9:6509:x1875734060598528:12345-0@lo:502: 00000100:00100000:2.0:1788839477.426559:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cab2b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+9:6509:x1875734060598528:12345-0@lo:502: Request processed in 129us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.426566:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839477.426638:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6509:1875734060598528:0@lo:502: 00000020:01000000:3.0:1788839477.426669:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839477.426674:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839477.426676:0:6509:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788839477.426680:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788839477.426944:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788839477.426965:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788839477.426987:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.426997:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839477.427005:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab745341000 from 1 10000000:01000000:0.0:1788839477.427008:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839477.427052:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.427080:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.427309:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839477.427329:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076911f94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598656:0@lo:101: 00000100:00100000:0.0:1788839477.427369:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839477.427508:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a321aa going to sleep for 11 seconds 00000100:00100000:1.0:1788839477.427569:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598656 00000100:00100000:1.0:1788839477.427576:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598656 00000100:00100000:1.0:1788839477.427603:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839477.427610:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000989c217d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+9:6464:x1875734060598656:12345-0@lo:101: 00010000:00010000:1.0:1788839477.427621:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839477.427635:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265726bb expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.427657:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265726bb expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.427668:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265726bb expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.427677:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034ce9a83, rc 0) 00000100:00100000:1.0:1788839477.427730:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000989c217d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+10:6464:x1875734060598656:12345-0@lo:101: Request processed in 120us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.427737:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839477.427917:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076911f94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598656:0@lo:101: 00010000:00010000:0.0:1788839477.427931:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.427939:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839477.428525:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076911f94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598784:0@lo:256: 00000100:00100000:0.0:1788839477.428560:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839477.428581:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a321aa going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.428943:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598784 00000100:00100000:2.0:1788839477.428957:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598784 00000100:00100000:2.0:1788839477.428990:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839477.428997:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c19730d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+10:6464:x1875734060598784:12345-0@lo:256: 20000000:01000000:2.0:1788839477.429030:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788839477.429036:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788839477.429529:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c19730d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+10:6464:x1875734060598784:12345-0@lo:256: Request processed in 532us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.429537:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839477.430055:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076911f94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598784:0@lo:256: 10000000:01000000:0.0:1788839477.432560:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839477.432594:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.432607:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839477.432638:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab745341000 from 1 10000000:01000000:0.0:1788839477.432641:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839477.432680:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.432688:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839477.432799:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839477.432822:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000076911f94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598912:0@lo:101: 00000100:00100000:0.0:1788839477.432887:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839477.432934:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000004a321aa going to sleep for 11 seconds 00000100:00100000:1.0:1788839477.433054:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060598912 00000100:00100000:1.0:1788839477.433071:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060598912 00000100:00100000:1.0:1788839477.433128:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839477.433136:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b03381ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+10:6464:x1875734060598912:12345-0@lo:101: 00010000:00010000:1.0:1788839477.433149:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839477.433164:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265726c9 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.433204:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265726c9 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.433223:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265726c9 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.433231:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000286625f7, rc 0) 00000100:00100000:1.0:1788839477.433269:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b03381ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+11:6464:x1875734060598912:12345-0@lo:101: Request processed in 135us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.433275:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839477.434044:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000076911f94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060598912:0@lo:101: 00010000:00010000:1.0:1788839477.434074:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.434089:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839477.434172:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000618d7068 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599040:0@lo:501: 00000100:00100000:1.0:1788839477.434228:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.434258:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2b3edbd going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.434316:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599040 00000100:00100000:2.0:1788839477.434322:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599040 00000100:00100000:2.0:1788839477.434357:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839477.434364:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000059a13ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+11:6464:x1875734060599040:12345-0@lo:501: 00000100:00100000:2.0:1788839477.434633:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000059a13ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+11:6464:x1875734060599040:12345-0@lo:501: Request processed in 269us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.434640:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839477.435091:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000618d7068 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599040:0@lo:501: 00000100:00100000:3.0:1788839477.435129:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599168:0@lo:503: 00000100:00100000:3.0:1788839477.435176:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.435223:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000001657535b going to sleep for 11 seconds 00000100:00100000:0.0:1788839477.435267:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599168 00000100:00100000:0.0:1788839477.435272:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599168 00000100:00100000:0.0:1788839477.435339:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839477.435346:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd185201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+11:6464:x1875734060599168:12345-0@lo:503: 00000040:00080000:0.0:1788839477.435387:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839477.435442:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd185201 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+11:6464:x1875734060599168:12345-0@lo:503: Request processed in 97us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839477.435449:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839477.435513:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599168:0@lo:503: 00000040:00080000:3.0:1788839477.436662:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788839477.436947:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788839477.436970:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839477.436992:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.437005:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839477.437057:0:6464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788839477.437061:0:6464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab745341000 10000000:01000000:1.0:1788839477.437075:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab745341000 10000000:01000000:1.0:1788839477.437079:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839477.437087:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab745341000 from 1 10000000:01000000:1.0:1788839477.437089:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839477.437122:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.437130:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.437140:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839477.437161:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e2a4d62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599296:0@lo:101: 00000100:00100000:1.0:1788839477.437226:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.437438:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000041d1d700 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.437570:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599296 00000100:00100000:2.0:1788839477.437577:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599296 00000100:00100000:2.0:1788839477.437613:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839477.437621:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e866b087 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+11:6464:x1875734060599296:12345-0@lo:101: 00010000:00010000:2.0:1788839477.437634:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839477.437647:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265726d7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.437669:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265726d7 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.437678:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265726d7 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.437945:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a296890e, rc 0) 00000100:00100000:2.0:1788839477.438031:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e866b087 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060599296:12345-0@lo:101: Request processed in 411us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.438037:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839477.438105:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e2a4d62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599296:0@lo:101: 00010000:00010000:3.0:1788839477.438119:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.438127:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.438210:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599424:0@lo:501: 00000100:00100000:3.0:1788839477.438241:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.438263:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a4a2c35 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.438306:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599424 00000100:00100000:2.0:1788839477.438311:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599424 00000100:00100000:2.0:1788839477.438329:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788839477.438335:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc38137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060599424:12345-0@lo:501: 00000100:00100000:2.0:1788839477.438832:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc38137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060599424:12345-0@lo:501: Request processed in 496us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.438840:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839477.438923:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599424:0@lo:501: 00000100:00100000:3.0:1788839477.438956:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599552:0@lo:503: 00000100:00100000:3.0:1788839477.439001:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.439025:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000000a4a2c35 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.439069:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599552 00000100:00100000:2.0:1788839477.439073:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599552 00000100:00100000:2.0:1788839477.439093:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788839477.439098:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b2d6b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060599552:12345-0@lo:503: 00000100:00100000:2.0:1788839477.439186:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b2d6b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060599552:12345-0@lo:503: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.439201:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839477.439270:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060599552:0@lo:503: 00000100:00100000:3.0:1788839477.439855:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6514:1875734060599680:0@lo:502: 00000100:00100000:3.0:1788839477.439895:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.439923:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000003438cd32 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.440021:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599680 00000100:00100000:2.0:1788839477.440027:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599680 00000100:00100000:2.0:1788839477.440060:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839477.440067:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0f2efbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6514:x1875734060599680:12345-0@lo:502: 00000100:00100000:2.0:1788839477.440156:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0f2efbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6514:x1875734060599680:12345-0@lo:502: Request processed in 90us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.440163:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839477.440276:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6514:1875734060599680:0@lo:502: 00000020:01000004:3.0:1788839477.440337:0:6514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788839477.440355:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000018d24a3a) 00000020:00000080:3.0:1788839477.440384:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788839477.440476:0:6514:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000226e8568 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788839477.440488:0:6514:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000226e8568 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788839477.440490:0:6514:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000226e8568 4 00010000:00080000:3.0:1788839477.440528:0:6514:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e1c49f6e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839477.445043:0:6514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788839477.445363:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788839477.445412:0:6514:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839477.445427:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad5b343a265726ec 00000100:00080000:3.0:1788839477.445437:0:6514:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839477.445443:0:6514:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e1c49f6e using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839477.445479:0:6514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005a12d6f4 x1875734060599808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839477.445507:0:6514:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788839477.445589:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060599808:0@lo:38: 00000100:00100000:0.0:1788839477.445664:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.445943:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599808 00000100:00100000:3.0:1788839477.445950:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599808 00000100:00100000:3.0:1788839477.445988:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839477.445995:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af0d0264 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060599808:12345-0@lo:38: 00000100:00100000:3.0:1788839477.446054:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af0d0264 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060599808:12345-0@lo:38: Request processed in 58us (389us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788839477.446061:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839477.446122:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839477.446130:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000e1c49f6e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839477.446134:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788839477.446144:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a12d6f4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060599808:0@lo:38: 00000100:00100000:2.0:1788839477.449101:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6514:1875734060599936:0@lo:502: 00000100:00100000:2.0:1788839477.449215:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839477.449263:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060599936 00000100:00100000:2.0:1788839477.449269:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060599936 00000100:00100000:2.0:1788839477.449315:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839477.449323:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000159d6d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6514:x1875734060599936:12345-0@lo:502: 00000100:00100000:2.0:1788839477.449430:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000159d6d90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6514:x1875734060599936:12345-0@lo:502: Request processed in 108us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839477.449438:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839477.449495:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054ce3115 going to sleep for 11 seconds 00000100:00100000:2.0:1788839477.449515:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:6514:1875734060599936:0@lo:502: 00000040:00080000:2.0:1788839477.449542:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788839477.449603:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788839477.449625:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839477.449639:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839477.449649:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839477.450187:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839477.450190:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839477.450191:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839477.450204:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839477.450205:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839477.450207:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839477.450208:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839477.450209:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839477.450211:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839477.450212:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839477.450214:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839477.450215:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839477.450225:0:6464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788839477.450228:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839477.450229:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839477.450230:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839477.450231:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839477.450232:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839477.450233:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839477.450234:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839477.450235:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839477.450236:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839477.450237:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839477.450237:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839477.450238:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839477.450253:0:6464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788839477.450262:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060600064:0@lo:253: 00000100:00100000:2.0:1788839477.450298:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839477.450318:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054ce3115 going to sleep for 11 seconds 00000100:00100000:0.0:1788839477.450593:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600064 00000100:00100000:0.0:1788839477.450600:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600064 00000100:00100000:0.0:1788839477.450640:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839477.450647:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007374d98b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060600064:12345-0@lo:253: 20000000:01000000:0.0:1788839477.450673:0:6480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788839477.450687:0:6480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788839477.460373:0:6480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788839477.460403:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788839477.460598:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788839477.460605:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788839477.460628:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.460651:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.460660:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.460737:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.460755:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.460801:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000284898dc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060600192:0@lo:104: 00000100:00100000:3.0:1788839477.460879:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839477.460929:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ac85c52e going to sleep for 11 seconds 00000100:00100000:3.0:1788839477.461301:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007374d98b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:6464:x1875734060600064:12345-0@lo:253: Request processed in 10652us (11001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839477.461311:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839477.461463:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600192 00000100:00100000:1.0:1788839477.461472:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600192 00000100:00100000:1.0:1788839477.461522:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839477.461530:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057b9b58c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:6503:x1875734060600192:12345-0@lo:104: 00010000:00010000:1.0:1788839477.461543:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.461591:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839477.461596:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057b9b58c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:6503:x1875734060600192:12345-0@lo:104: Request processed in 67us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.461601:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788839477.461617:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839477.461630:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.461637:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f3c04d3f already unused, calling callback (000000003cb70707) 10000000:00010000:1.0:1788839477.461640:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.461648:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839477.461655:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839477.461660:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839477.461688:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839477.461814:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000284898dc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060600192:0@lo:104: 00010000:00010000:3.0:1788839477.461839:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.461897:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839477.461922:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.461929:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000f3c04d3f/0xad5b343a265726bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726c2 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.461950:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839477.461951:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839477.461953:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839477.462089:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099005753 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060600320:0@lo:103: 00000100:00100000:3.0:1788839477.462122:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839477.462318:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600320 00000100:00100000:1.0:1788839477.462324:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600320 00010000:00010000:1.0:1788839477.462341:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839477.462384:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839477.462391:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000284898dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+12:3615:x1875734060600320:12345-0@lo:103: 00010000:00010000:1.0:1788839477.462402:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839477.462405:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462414:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462426:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034ce9a83/0xad5b343a265726c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265726bb expref: 12 pid: 6480 timeout: 282 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462440:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462447:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839477.462459:0:6472:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001856452s 00010000:00010000:1.0:1788839477.462463:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462469:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462475:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462480:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462492:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f870de7 already unused, calling callback (0000000057ea3cd3) 00010000:00010000:1.0:1788839477.462495:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462503:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462513:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839477.462521:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839477.462550:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000284898dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+11:3615:x1875734060600320:12345-0@lo:103: Request processed in 161us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839477.462557:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839477.462620:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099005753 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060600320:0@lo:103: 00010000:00010000:3.0:1788839477.462640:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.462647:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839477.462653:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f870de7/0xad5b343a265726f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839477.462849:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:6464:1875734060600064:0@lo:253: 10000000:01000000:2.0:1788839477.462860:0:6464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788839477.462863:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839477.462865:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839477.462866:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839477.462868:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839477.462869:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839477.462870:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839477.462871:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839477.462872:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839477.462874:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839477.462875:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839477.462876:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839477.462877:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788839477.462888:0:6464:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788839477.474431:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788839477.474607:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788839477.474860:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788839477.475020:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788839477.475222:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788839477.475411:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788839477.477609:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.477973:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788839477.478133:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.478301:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788839477.478471:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788839477.478608:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788839477.481651:0:6464:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788839477.491080:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788839477.491468:0:6519:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788839477.491472:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788839477.491521:0:6520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788839477.493161:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788839477.493450:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788839477.494024:0:6464:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788839477.494034:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788839477.494147:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839477.497322:0:6464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788839477.498034:0:6464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788839477.498064:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788839477.498600:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788839477.499078:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:2.0:1788839477.499290:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839477.503647:0:6520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788839477.504386:0:6520:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788839477.504393:0:6520:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788839477.505335:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788839477.505456:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788839477.505576:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788839477.505683:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788839477.506068:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788839477.506268:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788839477.506410:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788839477.506561:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788839477.506689:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788839477.506978:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788839477.507136:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788839477.507365:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788839477.507499:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788839477.507635:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788839477.508099:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788839477.508320:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788839477.508616:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788839477.508906:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788839477.509056:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788839477.509282:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788839477.509422:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788839477.509572:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788839477.509721:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788839477.510089:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788839477.510317:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788839477.510479:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788839477.510615:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788839477.510753:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788839477.511117:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788839477.511340:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788839477.511588:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788839477.511724:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788839477.512118:0:6464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788839477.515171:0:6464:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788839477.515229:0:6464:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb69881c43988 00100000:10000000:0.0:1788839477.515248:0:6464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788839477.515908:0:6464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788839477.515924:0:6464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788839477.515943:0:6464:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788839477.515959:0:6464:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788839477.516716:0:6464:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839477.516913:0:6464:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1788839478.079036:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839479.103264:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839480.137336:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839481.152241:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839482.175839:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839482.753174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839482.753187:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788839482.753190:0:8:0:(import.c:65:import_set_state_nolock()) 00000000e1c49f6e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839482.753204:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e1c49f6e using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839482.753229:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002d0903bf x1875734060600576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839482.753334:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839482.753349:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060600448:0@lo:400: 00000100:00100000:3.0:1788839482.753432:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.753501:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600448 00000100:00100000:3.0:1788839482.753510:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600448 00000100:00100000:3.0:1788839482.753567:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839482.753577:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041a10170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+11:3617:x1875734060600448:12345-0@lo:400: 00000100:00100000:3.0:1788839482.753658:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041a10170 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+11:3617:x1875734060600448:12345-0@lo:400: Request processed in 83us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839482.753666:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839482.753720:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060600448:0@lo:400: 00000100:00100000:0.0:1788839482.754085:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060600576:0@lo:38: 00000100:00100000:0.0:1788839482.754120:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839482.755815:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600576 00000100:00100000:3.0:1788839482.755828:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600576 00000100:00100000:3.0:1788839482.755883:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839482.755890:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ccfdff9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060600576:12345-0@lo:38: 00010000:00080000:3.0:1788839482.755922:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:3.0:1788839482.755957:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad5b343a265726fa 00000004:00100000:3.0:1788839482.756009:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839482.756127:0:6489:0:(import.c:65:import_set_state_nolock()) 00000000932f3027 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839482.756343:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ccfdff9b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875734060600576:12345-0@lo:38: Request processed in 452us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839482.756350:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839482.756398:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d0903bf x1875734060600576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788839482.756415:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788839482.756421:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788839482.756425:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839482.756427:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000e1c49f6e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839482.756432:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060600576:0@lo:38: 00010000:00010000:1.0:1788839483.204046:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839483.386246:0:6765:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788839484.223062:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788839484.585265:0:6817:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839484.585454:0:6817:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788839485.250329:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788839485.822901:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839485.822910:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab745341000 from 3 10000000:01000000:2.0:1788839485.822915:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839485.822968:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839485.822982:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839485.822992:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839485.823016:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060600704:0@lo:101: 00000100:00100000:2.0:1788839485.823090:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839485.823180:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d6f8dbd0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839485.823331:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600704 00000100:00100000:3.0:1788839485.823339:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600704 00000100:00100000:3.0:1788839485.823418:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839485.823426:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb8a2bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+11:6483:x1875734060600704:12345-0@lo:101: 00010000:00010000:3.0:1788839485.823439:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839485.823450:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572701 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839485.823473:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572701 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839485.823492:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572701 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839485.823500:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e5c3be5f, rc 0) 00000100:00100000:3.0:1788839485.823870:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb8a2bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:6483:x1875734060600704:12345-0@lo:101: Request processed in 443us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839485.823877:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839485.823982:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008402e5a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060600704:0@lo:101: 00010000:00010000:0.0:1788839485.823997:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839485.824006:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839485.824056:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028410d4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060600832:0@lo:256: 00000100:00100000:0.0:1788839485.824090:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839485.824122:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aa249f0c going to sleep for 11 seconds 00000100:00100000:1.0:1788839485.824188:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600832 00000100:00100000:1.0:1788839485.824192:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600832 00000100:00100000:1.0:1788839485.824226:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788839485.824232:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2874d3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6483:x1875734060600832:12345-0@lo:256: 20000000:01000000:1.0:1788839485.824246:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788839485.824260:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788839485.824263:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788839485.824347:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2874d3a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:6483:x1875734060600832:12345-0@lo:256: Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839485.824354:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839485.824496:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028410d4c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060600832:0@lo:256: 10000000:01000000:0.0:1788839485.824555:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839485.824561:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839485.824570:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839486.271587:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839487.296078:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788839487.705608:0:6919:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839487.705806:0:6919:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788839487.882579:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839487.882605:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000579866de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060601088:0@lo:400: 00000100:00100000:1.0:1788839487.882693:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839487.882766:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601088 00000100:00100000:0.0:1788839487.882894:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a2cfa46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060600960:0@lo:400: 00000100:00100000:0.0:1788839487.882940:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839487.882977:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060600960 00000100:00100000:0.0:1788839487.882983:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060600960 00000100:00100000:0.0:1788839487.883028:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788839487.883035:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000634943b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:3617:x1875734060600960:12345-0@lo:400: 00000100:00100000:0.0:1788839487.883081:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000634943b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:3617:x1875734060600960:12345-0@lo:400: Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839487.883088:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788839487.883144:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a2cfa46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060600960:0@lo:400: 00000100:00100000:1.0:1788839487.883205:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601088 00000100:00100000:1.0:1788839487.883243:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839487.883250:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070761c4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060601088:12345-0@lo:400: 00000100:00100000:1.0:1788839487.883287:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070761c4c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060601088:12345-0@lo:400: Request processed in 38us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839487.883294:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788839487.883413:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000579866de x1875734060601088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839487.883425:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000579866de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060601088:0@lo:400: 00010000:00010000:3.0:1788839488.319913:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839489.343908:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839490.367285:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839491.398202:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839492.424689:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839493.000851:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839493.000875:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028410d4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060601216:0@lo:400: 00000100:00100000:0.0:1788839493.000947:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839493.001011:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d63790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060601344:0@lo:400: 00000100:00100000:0.0:1788839493.001037:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839493.001075:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601344 00000100:00100000:0.0:1788839493.001082:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601344 00000100:00100000:0.0:1788839493.001135:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839493.001141:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028c43160 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060601344:12345-0@lo:400: 00000100:00100000:0.0:1788839493.001186:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028c43160 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060601344:12345-0@lo:400: Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839493.001193:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788839493.001225:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e9d63790 x1875734060601344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839493.001238:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d63790 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060601344:0@lo:400: 00000100:00100000:3.0:1788839493.001824:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601216 00000100:00100000:3.0:1788839493.001829:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601216 00000100:00100000:3.0:1788839493.001864:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788839493.001869:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc85af6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+12:3614:x1875734060601216:12345-0@lo:400: 00000100:00100000:3.0:1788839493.001921:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc85af6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+12:3614:x1875734060601216:12345-0@lo:400: Request processed in 52us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839493.001927:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839493.002063:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028410d4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060601216:0@lo:400: 00010000:00010000:3.0:1788839493.461115:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839494.471111:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839495.487011:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839496.529991:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839497.536464:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839498.112275:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060601600:0@lo:400: 00000100:00100000:3.0:1788839498.112365:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839498.112449:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601600 00000100:00100000:3.0:1788839498.112457:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601600 00000100:00100000:3.0:1788839498.112505:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839498.112529:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001bb4aef2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060601600:12345-0@lo:400: 00000100:00100000:3.0:1788839498.112583:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001bb4aef2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060601600:12345-0@lo:400: Request processed in 71us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839498.112590:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788839498.112711:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042a889d4 x1875734060601600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839498.112726:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060601600:0@lo:400: 00000100:00100000:1.0:1788839498.112796:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839498.112806:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060601472:0@lo:400: 00000100:00100000:1.0:1788839498.112842:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839498.113434:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601472 00000100:00100000:3.0:1788839498.113440:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601472 00000100:00100000:3.0:1788839498.113516:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839498.113522:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ba0b384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:3616:x1875734060601472:12345-0@lo:400: 00000100:00100000:3.0:1788839498.113575:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ba0b384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:3616:x1875734060601472:12345-0@lo:400: Request processed in 53us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839498.113581:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839498.113641:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060601472:0@lo:400: 00010000:00010000:3.0:1788839498.568564:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839499.584522:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839500.606984:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788839501.621867:0:7418:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788839501.621882:0:7418:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788839501.621884:0:7418:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788839501.622259:0:7418:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c3cb25c9 00000020:01000004:0.0:1788839501.622274:0:7418:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:0.0:1788839501.622284:0:7418:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788839501.622307:0:7418:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000008b3b28a2) 00000020:00000080:0.0:1788839501.622322:0:7418:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788839501.634413:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788839501.720604:0:7418:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788839501.720688:0:7418:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788839501.794608:0:7418:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788839501.794896:0:7418:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788839501.794908:0:7418:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839501.794920:0:7418:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26572716 00000020:01000004:3.0:1788839501.794927:0:7418:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788839501.794955:0:7418:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788839501.794958:0:7418:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788839501.794964:0:7418:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788839501.794993:0:7418:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788839501.794997:0:7418:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788839501.860473:0:7418:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788839501.860511:0:7418:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788839501.860516:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788839501.860518:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788839501.860519:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839501.860520:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839501.860521:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839501.860523:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839501.860524:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839501.860525:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788839501.860526:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788839501.860528:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839501.860529:0:7418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788839501.860533:0:7418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788839501.860536:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788839501.860537:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788839501.860538:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839501.860539:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839501.860540:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839501.860541:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839501.860542:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839501.860542:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788839501.860543:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788839501.860545:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839501.860545:0:7418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788839501.860570:0:7418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788839501.860588:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d63790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060601728:0@lo:253: 00000100:00100000:0.0:1788839501.860898:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839501.861026:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f60fb23b going to sleep for 11 seconds 00000100:00100000:1.0:1788839501.861127:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601728 00000100:00100000:1.0:1788839501.861134:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601728 00000100:00100000:1.0:1788839501.861276:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839501.861284:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c4fcf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060601728:12345-0@lo:253: 20000000:01000000:1.0:1788839501.861321:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788839501.861325:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788839501.861330:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788839501.861334:0:6479:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788839501.861363:0:6479:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788839501.861570:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839501.861843:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788839501.861856:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788839501.861875:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788839501.861890:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788839501.861903:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788839501.861952:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788839501.861959:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788839501.861971:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788839501.861976:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788839501.861989:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788839501.861994:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788839501.862005:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788839501.862041:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788839501.862161:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788839501.862171:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788839501.862186:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788839501.862192:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788839501.862205:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788839501.862210:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788839501.862223:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788839501.862228:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788839501.862241:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788839501.862256:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788839501.862266:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788839501.862372:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:1.0:1788839501.862381:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:1.0:1788839501.862394:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:1.0:1788839501.862408:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:1.0:1788839501.862421:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:1.0:1788839501.862426:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:1.0:1788839501.862438:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:1.0:1788839501.862457:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:1.0:1788839501.862462:0:6479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:1.0:1788839501.862493:0:6479:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788839501.862500:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788839501.864415:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1788839501.864746:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788839501.865007:0:6479:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:1.0:1788839501.865011:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788839501.865097:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788839501.865105:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788839501.865118:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788839501.865124:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788839501.865141:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788839501.865215:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1788839501.865233:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1788839501.865253:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1788839501.865318:0:6479:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1788839501.865328:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788839501.865958:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1788839501.866282:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788839501.866301:0:6479:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:1.0:1788839501.866302:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788839501.866318:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788839501.866324:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788839501.866335:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788839501.866350:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788839501.866363:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788839501.866369:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1788839501.866380:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788839501.866396:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1788839501.866419:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788839501.866422:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788839501.866425:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788839501.866488:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788839501.866491:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788839501.867001:0:7426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788839501.867101:0:7426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788839501.867118:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788839501.867387:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788839501.867404:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788839501.867424:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788839501.867435:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788839501.867437:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788839501.867992:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788839501.868087:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788839501.868109:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788839501.868333:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1788839501.868354:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1788839501.868368:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1788839501.868378:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788839501.868379:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788839501.868749:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788839501.868766:0:7428:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788839501.868886:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1788839501.869103:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1788839501.869136:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1788839501.869226:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1788839501.869244:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788839501.869247:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788839501.869251:0:6479:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788839501.869257:0:6479:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788839501.869524:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788839501.869754:0:6479:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788839501.880550:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788839501.880581:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.880627:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657264b expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.880634:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572667 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.880639:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265726d7 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.880645:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.881215:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265726d7 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.881234:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265726d7 expref: 12 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.881249:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000579866de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060601856:0@lo:104: 00000100:00100000:1.0:1788839501.881320:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839501.881380:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572667 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.881387:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572667 expref: 12 pid: 6481 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.881394:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030c57877 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060601984:0@lo:104: 00000100:00100000:1.0:1788839501.881415:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839501.881441:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657264b expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.881457:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657264b expref: 12 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.881464:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060602112:0@lo:104: 00000100:00100000:1.0:1788839501.881487:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839501.881497:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f200b9a going to sleep for 11 seconds 00000100:00100000:2.0:1788839501.881564:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601856 00000100:00100000:2.0:1788839501.881572:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601856 00000100:00100000:2.0:1788839501.881622:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060601984 00000100:00100000:2.0:1788839501.881625:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060601984 00000100:00100000:2.0:1788839501.881645:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602112 00000100:00100000:2.0:1788839501.881648:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602112 00000100:00100000:2.0:1788839501.881660:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839501.881667:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058f8081f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6479:x1875734060601856:12345-0@lo:104: 00010000:00010000:2.0:1788839501.881750:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839501.881830:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839501.881835:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058f8081f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6479:x1875734060601856:12345-0@lo:104: Request processed in 169us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839501.881844:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839501.881860:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839501.881864:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068f54849 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:6479:x1875734060601984:12345-0@lo:104: 00010000:00010000:2.0:1788839501.881870:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839501.881897:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839501.881900:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068f54849 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:6479:x1875734060601984:12345-0@lo:104: Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839501.881905:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839501.881915:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839501.881920:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fcf9140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:6479:x1875734060602112:12345-0@lo:104: 00010000:00010000:2.0:1788839501.881925:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839501.881948:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788839501.881951:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fcf9140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:6479:x1875734060602112:12345-0@lo:104: Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839501.881966:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788839501.882046:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788839501.882052:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882059:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1ad82b5 already unused, calling callback (000000003cb70707) 10000000:00010000:3.0:1788839501.882062:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882069:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839501.882075:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839501.882091:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839501.882125:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882132:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839501.882259:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882267:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265726d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726de expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882283:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839501.882286:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882291:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e3ab414 already unused, calling callback (000000003cb70707) 10000000:00010000:3.0:1788839501.882293:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882299:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839501.882303:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839501.882308:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839501.882320:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882325:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839501.882346:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882352:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 000000001e3ab414/0xad5b343a26572667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657266e expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882362:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839501.882364:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882370:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008be9d29f already unused, calling callback (000000003cb70707) 10000000:00010000:3.0:1788839501.882372:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882377:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839501.882382:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839501.882386:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839501.882397:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882403:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839501.882407:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882412:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 000000008be9d29f/0xad5b343a2657264b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572652 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882425:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839501.882432:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839501.882434:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839501.882446:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060602240:0@lo:103: 00000100:00100000:3.0:1788839501.882477:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839501.882512:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e029b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060602368:0@lo:103: 00000100:00100000:3.0:1788839501.882534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839501.882551:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839501.882556:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000794a07d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060602496:0@lo:103: 00000100:00100000:3.0:1788839501.882573:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839501.882603:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602240 00000100:00100000:3.0:1788839501.882608:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602240 00010000:00010000:3.0:1788839501.882628:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265726d7 expref: 13 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839501.882644:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602368 00000100:00100000:3.0:1788839501.882647:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602368 00010000:00010000:3.0:1788839501.882655:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572667 expref: 14 pid: 6481 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839501.882664:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602496 00000100:00100000:3.0:1788839501.882666:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602496 00010000:00010000:3.0:1788839501.882673:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657264b expref: 15 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839501.882759:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839501.882766:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb11f188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+15:3615:x1875734060602240:12345-0@lo:103: 00010000:00010000:3.0:1788839501.882800:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839501.882804:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265726d7 expref: 15 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882825:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265726d7 expref: 15 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882838:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839501.882865:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb11f188 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+15:3615:x1875734060602240:12345-0@lo:103: Request processed in 101us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839501.882871:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839501.882885:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839501.882890:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49cc058 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+14:3616:x1875734060602368:12345-0@lo:103: 00010000:00010000:3.0:1788839501.882896:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839501.882899:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572667 expref: 14 pid: 6481 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882906:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572667 expref: 14 pid: 6481 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882915:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839501.882934:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49cc058 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+14:3616:x1875734060602368:12345-0@lo:103: Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839501.882939:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839501.882950:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839501.882955:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000977a443b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+13:3616:x1875734060602496:12345-0@lo:103: 00010000:00010000:3.0:1788839501.882961:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839501.882963:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657264b expref: 13 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882970:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657264b expref: 13 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882985:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.882991:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883004:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883010:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883245:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883251:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883256:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030e6f8cf already unused, calling callback (0000000057ea3cd3) 00010000:00010000:3.0:1788839501.883259:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883265:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883272:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.883281:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839501.883304:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000977a443b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+13:3616:x1875734060602496:12345-0@lo:103: Request processed in 349us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839501.883321:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839501.883362:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060602240:0@lo:103: 00000100:00100000:3.0:1788839501.883388:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000794a07d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060602496:0@lo:103: 00000100:00100000:3.0:1788839501.883396:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e029b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060602368:0@lo:103: 00010000:00010000:1.0:1788839501.883532:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839501.883553:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a296890e/0xad5b343a265726de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265726d7 expref: 12 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.883564:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000579866de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060601856:0@lo:104: 00010000:00010000:1.0:1788839501.883573:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000db4641e/0xad5b343a2657266e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572667 expref: 11 pid: 6481 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.883580:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030c57877 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060601984:0@lo:104: 00010000:00010000:1.0:1788839501.883587:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdb49716/0xad5b343a26572652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657264b expref: 10 pid: 6479 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.883593:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060602112:0@lo:104: 00010000:00010000:1.0:1788839501.883617:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.883626:0:6479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.883631:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.883647:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000030e6f8cf/0xad5b343a2657271d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839501.883665:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788839501.886239:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c4fcf89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+9:7418:x1875734060601728:12345-0@lo:253: Request processed in 24950us (25334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839501.886254:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839501.886404:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d63790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060601728:0@lo:253: 10000000:01000000:0.0:1788839501.886429:0:7418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788839501.886433:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839501.886435:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788839501.886436:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839501.886437:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788839501.886439:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839501.886440:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839501.886442:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839501.886443:0:7418:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788839501.886445:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839501.886446:0:7418:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788839501.886465:0:7418:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c3cb25c9 from lustre-MDT0001 10000000:01000000:0.0:1788839501.886495:0:7418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788839501.886498:0:7418:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788839501.886505:0:7418:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab7486e8000 local copy 10000000:01000000:0.0:1788839501.886509:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788839501.886544:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.886554:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.886563:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839501.886580:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e9d63790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060602624:0@lo:101: 00000100:00100000:0.0:1788839501.886624:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839501.886663:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f60fb23b going to sleep for 11 seconds 00000100:00100000:3.0:1788839501.886810:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602624 00000100:00100000:3.0:1788839501.886817:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602624 00000100:00100000:3.0:1788839501.886851:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788839501.886858:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073d70d1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+9:7418:x1875734060602624:12345-0@lo:101: 00010000:00010000:3.0:1788839501.886871:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839501.886884:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea03fc2f/0xad5b343a2657272b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572724 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.886906:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea03fc2f/0xad5b343a2657272b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572724 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.886914:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea03fc2f/0xad5b343a2657272b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572724 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.886922:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea03fc2f, rc 0) 00000100:00100000:3.0:1788839501.886956:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073d70d1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+10:7418:x1875734060602624:12345-0@lo:101: Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839501.886961:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839501.887253:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e9d63790 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060602624:0@lo:101: 00010000:00010000:1.0:1788839501.887266:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887274:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.887360:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060602752:0@lo:501: 00000100:00100000:1.0:1788839501.887387:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839501.887417:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000730ede6b going to sleep for 11 seconds 00000100:00100000:0.0:1788839501.887465:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602752 00000100:00100000:0.0:1788839501.887470:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602752 00000100:00100000:0.0:1788839501.887500:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788839501.887506:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb272da7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+10:7418:x1875734060602752:12345-0@lo:501: 00000100:00100000:0.0:1788839501.887579:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb272da7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+10:7418:x1875734060602752:12345-0@lo:501: Request processed in 73us (192us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839501.887586:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839501.887812:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060602752:0@lo:501: 10000000:01000000:1.0:1788839501.887824:0:7418:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788839501.887841:0:7418:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788839501.887845:0:7418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887851:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887856:0:7418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887876:0:7418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839501.887913:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab74434b000 10000000:01000000:1.0:1788839501.887918:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839501.887923:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab7486e8000 10000000:01000000:1.0:1788839501.887925:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788839501.887928:0:7418:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ab7486e8000 from 1 10000000:01000000:1.0:1788839501.887930:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788839501.887945:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887951:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.887958:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.887969:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060602880:0@lo:101: 00000100:00100000:1.0:1788839501.887994:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839501.888109:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060602880 00000100:00100000:0.0:1788839501.888113:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060602880 00000100:00100000:0.0:1788839501.888139:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839501.888155:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032c5448f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+10:7418:x1875734060602880:12345-0@lo:101: 00010000:00010000:0.0:1788839501.888162:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839501.888173:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff07a2be/0xad5b343a26572739 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572732 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.888187:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff07a2be/0xad5b343a26572739 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572732 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.888194:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff07a2be/0xad5b343a26572739 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572732 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.888200:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff07a2be, rc 0) 00000100:00100000:0.0:1788839501.888225:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032c5448f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+11:7418:x1875734060602880:12345-0@lo:101: Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839501.888230:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1788839501.888353:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839501.888359:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.888366:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea3c22b7 already unused, calling callback (000000003cb70707) 10000000:00010000:3.0:1788839501.888377:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.888384:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839501.888389:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839501.888393:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839501.888408:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.888413:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839501.888427:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.888432:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000ea3c22b7/0xad5b343a26572724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a2657272b expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.888447:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839501.888449:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839501.888450:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839501.888456:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839501.888464:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006e029b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060603008:0@lo:103: 00000100:00100000:3.0:1788839501.888491:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839501.888523:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603008 00000100:00100000:3.0:1788839501.888526:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603008 00000100:00100000:3.0:1788839501.888550:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839501.888556:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000794a07d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+11:3615:x1875734060603008:12345-0@lo:103: 00010000:00010000:3.0:1788839501.888563:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839501.888577:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea03fc2f/0xad5b343a2657272b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572724 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.888587:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839501.888611:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000794a07d9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+10:3615:x1875734060603008:12345-0@lo:103: Request processed in 56us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839501.888628:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839501.888655:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006e029b67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060603008:0@lo:103: 00000100:00100000:1.0:1788839501.888825:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db77406d going to sleep for 11 seconds 00000100:00100000:1.0:1788839501.888837:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060602880:0@lo:101: 00010000:00010000:1.0:1788839501.888846:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.888852:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839501.888865:0:7418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788839501.888877:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.888889:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000c900b936/0xad5b343a26572732 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839501.888897:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab74434b000 10000000:01000000:1.0:1788839501.888900:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788839501.888904:0:7418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab74434b000 from 1 10000000:01000000:1.0:1788839501.888906:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788839501.888920:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.888925:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.888931:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.888942:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603136:0@lo:101: 00000100:00100000:1.0:1788839501.888967:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839501.888978:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db77406d going to sleep for 11 seconds 00000100:00100000:3.0:1788839501.889107:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603136 00000100:00100000:3.0:1788839501.889111:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603136 00000100:00100000:3.0:1788839501.889142:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839501.889216:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ffe7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+10:7418:x1875734060603136:12345-0@lo:101: 00010000:00010000:3.0:1788839501.889224:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839501.889232:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f870de7/0xad5b343a26572747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572740 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.889245:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f870de7/0xad5b343a26572747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572740 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.889253:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f870de7/0xad5b343a26572747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572740 expref: 11 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839501.889259:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f870de7, rc 0) 00000100:00100000:3.0:1788839501.889286:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ffe7b14 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+11:7418:x1875734060603136:12345-0@lo:101: Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839501.889291:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839501.889355:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603136:0@lo:101: 00010000:00010000:1.0:1788839501.889364:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.889371:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839501.889380:0:7418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788839501.889393:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.889405:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000002c2806b0/0xad5b343a26572740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839501.889410:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788839501.889413:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839501.889417:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab74434b000 10000000:01000000:1.0:1788839501.889419:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788839501.889422:0:7418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788839501.889424:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788839501.889437:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.889444:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.889449:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.889459:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603264:0@lo:101: 00000100:00100000:1.0:1788839501.889484:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839501.889500:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db77406d going to sleep for 11 seconds 00000100:00100000:0.0:1788839501.889560:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603264 00000100:00100000:0.0:1788839501.889564:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603264 00000100:00100000:0.0:1788839501.889597:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839501.889603:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004da2b3ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+11:7418:x1875734060603264:12345-0@lo:101: 00010000:00010000:0.0:1788839501.889610:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839501.889629:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c954311/0xad5b343a26572755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657274e expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.889652:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c954311/0xad5b343a26572755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657274e expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.889659:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c954311/0xad5b343a26572755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657274e expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839501.889665:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c954311, rc 0) 00000100:00100000:0.0:1788839501.890041:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004da2b3ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603264:12345-0@lo:101: Request processed in 437us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839501.890048:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839501.890436:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603264:0@lo:101: 00010000:00010000:1.0:1788839501.890448:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839501.890455:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839501.890545:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603392:0@lo:501: 00000100:00100000:1.0:1788839501.890573:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839501.890651:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000db77406d going to sleep for 11 seconds 00000100:00100000:0.0:1788839501.891390:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603392 00000100:00100000:0.0:1788839501.891398:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603392 00000100:00100000:0.0:1788839501.891439:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788839501.891446:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a85c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603392:12345-0@lo:501: 00000100:00100000:0.0:1788839501.891558:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a85c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603392:12345-0@lo:501: Request processed in 112us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839501.891564:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788839501.891653:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603392:0@lo:501: 00000100:00100000:2.0:1788839501.891833:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8d75abe pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603520:0@lo:503: 00000100:00100000:2.0:1788839501.891877:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839501.891910:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59b33ce going to sleep for 11 seconds 00000100:00100000:1.0:1788839501.891975:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603520 00000100:00100000:1.0:1788839501.891980:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603520 00000100:00100000:1.0:1788839501.892020:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839501.892035:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa53a460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603520:12345-0@lo:503: 00000100:00100000:1.0:1788839501.892113:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa53a460 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603520:12345-0@lo:503: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839501.892120:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839501.892314:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8d75abe pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603520:0@lo:503: 00000040:00080000:2.0:1788839501.892554:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839501.892635:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f8d75abe pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603648:0@lo:502: 00000100:00100000:2.0:1788839501.892668:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839501.892795:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f59b33ce going to sleep for 11 seconds 00000100:00100000:0.0:1788839501.892915:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603648 00000100:00100000:0.0:1788839501.892921:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603648 00000100:00100000:0.0:1788839501.892953:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839501.892958:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000055ded2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603648:12345-0@lo:502: 00000100:00100000:0.0:1788839501.893051:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000055ded2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603648:12345-0@lo:502: Request processed in 93us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839501.893057:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839501.893093:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f8d75abe pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603648:0@lo:502: 00000040:00080000:0.0:1788839501.893414:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788839501.893445:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1788839501.893460:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1788839501.893472:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1788839501.893483:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1788839501.893495:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1788839501.893508:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1788839501.893522:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1788839501.893535:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1788839501.893547:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1788839501.893558:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1788839501.893571:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1788839501.893583:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1788839501.893595:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1788839501.893608:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1788839501.893637:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1788839501.893651:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1788839501.893664:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1788839501.893831:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1788839501.893854:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1788839501.893868:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1788839501.893881:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1788839501.893891:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1788839501.893915:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000034e766fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603776:0@lo:502: 00000100:00100000:0.0:1788839501.893954:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839501.893980:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2aa68f4 going to sleep for 11 seconds 00000100:00100000:0.0:1788839501.893996:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603776 00000100:00100000:0.0:1788839501.894001:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603776 00000100:00100000:0.0:1788839501.894096:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839501.894103:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f486a2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603776:12345-0@lo:502: 00000100:00100000:0.0:1788839501.894257:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f486a2e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060603776:12345-0@lo:502: Request processed in 155us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839501.894272:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839501.894313:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000034e766fd pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060603776:0@lo:502: 00000040:00080000:0.0:1788839501.894352:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1788839501.894358:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788839501.895065:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839501.895077:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839501.895080:0:7430:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788839501.895084:0:7430:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788839501.895087:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839501.895102:0:7430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000074e54261) 00000020:00000080:1.0:1788839501.895121:0:7430:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788839501.895127:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788839501.895318:0:7430:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788839501.895325:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26572763 00000020:00000080:1.0:1788839501.895553:0:7430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788839501.895558:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839501.895561:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839501.895563:0:7430:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788839501.895565:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839501.895568:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839501.895570:0:7430:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788839501.895573:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839501.895580:0:7430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000805d9279) 00000020:00000080:1.0:1788839501.895596:0:7430:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788839501.895601:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788839501.895603:0:7430:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788839501.895605:0:7430:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788839501.895622:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839501.895667:0:7430:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3cb25c9 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788839501.895702:0:7430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000005cb67c3b) 00000020:00000080:1.0:1788839501.895713:0:7430:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788839501.895814:0:7430:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788839501.895820:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26572778 00000020:00000080:1.0:1788839501.895903:0:7430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788839501.895909:0:7430:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788839501.895914:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xad5b343a2657277f 00080000:01000000:1.0:1788839501.895919:0:7430:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788839501.895922:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26572786 00080000:10000000:1.0:1788839501.896969:0:7430:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788839501.897254:0:7430:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788839501.995133:0:7430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788839501.995442:0:7430:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788839502.000156:0:7430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788839502.001630:0:7430:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788839502.034434:0:7430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788839502.034450:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839502.034458:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839502.034461:0:7430:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788839502.034464:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839502.034470:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839502.034471:0:7430:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788839502.034475:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788839502.034480:0:7430:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:0.0:1788839502.034510:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788839502.034890:0:7430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000091e1e896) 00000020:00000080:0.0:1788839502.034914:0:7430:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788839502.034922:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788839502.035353:0:7430:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788839502.035360:0:7430:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788839502.035368:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26572794 00010000:00080000:0.0:1788839502.035399:0:7430:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000472153b7@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788839502.038739:0:7430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788839502.040294:0:7430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839502.040308:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788839502.040346:0:7430:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788839502.040366:0:7430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a2657279b 00000100:00080000:1.0:1788839502.040377:0:7430:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839502.040382:0:7430:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000472153b7 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839502.040415:0:7430:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000030c57877 x1875734060603904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839502.040475:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000030c57877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060603904:0@lo:38: 00000100:00080000:1.0:1788839502.040663:0:7430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788839502.040792:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788839502.040928:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839502.040933:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839502.040935:0:7430:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788839502.040945:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839502.040948:0:7430:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788839502.040949:0:7430:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839502.040950:0:7430:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839502.040952:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839502.040954:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839502.040955:0:7430:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839502.040957:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839502.040962:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839502.040962:0:7430:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788839502.040966:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788839502.041012:0:7430:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788839502.041025:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839502.041038:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839502.041039:0:7430:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788839502.041042:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839502.041044:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839502.041046:0:7430:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788839502.041049:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788839502.041050:0:7430:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788839502.041075:0:7430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839502.041078:0:7430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839502.041079:0:7430:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788839502.041082:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:0.0:1788839502.041235:0:7418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1788839502.041278:0:7418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788839502.041295:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.041304:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000034ce9a83/0xad5b343a2657274e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839502.041311:0:7418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab74434b000 from 1 10000000:01000000:0.0:1788839502.041313:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839502.041451:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.041459:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.041468:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839502.041483:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000513b7411 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604032:0@lo:101: 00000100:00100000:0.0:1788839502.041514:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839502.041548:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 0000000066964fcc going to sleep for 11 seconds 00000100:00100000:1.0:1788839502.041913:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839502.041922:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c7fda917 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060604160:0@lo:400: 00000100:00100000:2.0:1788839502.041933:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060603904 00000100:00100000:2.0:1788839502.041939:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060603904 00000100:00100000:1.0:1788839502.041952:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839502.041968:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839502.041974:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034e766fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060603904:12345-0@lo:38: 00010000:00080000:2.0:1788839502.041994:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 156 last 0 00000100:00100000:0.0:1788839502.042006:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604032 00000100:00100000:0.0:1788839502.042011:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604032 00000100:00100000:0.0:1788839502.042052:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839502.042058:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad7c281f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+12:7418:x1875734060604032:12345-0@lo:101: 00000020:00000080:2.0:1788839502.042063:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a265727a9 00010000:00010000:0.0:1788839502.042069:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00100000:2.0:1788839502.042077:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00010000:0.0:1788839502.042080:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265727a2 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788839502.042082:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788839502.042100:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265727a2 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.042118:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727a2 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.042126:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ea3c22b7, rc 0) 00000100:00100000:0.0:1788839502.042458:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad7c281f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+13:7418:x1875734060604032:12345-0@lo:101: Request processed in 399us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839502.042465:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839502.042495:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604160 00000100:00100000:0.0:1788839502.042498:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604160 00000100:00100000:0.0:1788839502.042537:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839502.042543:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000579866de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060604160:12345-0@lo:400: 00000100:00100000:0.0:1788839502.042590:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000579866de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060604160:12345-0@lo:400: Request processed in 48us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839502.042595:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839502.042635:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c7fda917 x1875734060604160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839502.042647:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c7fda917 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060604160:0@lo:400: 00000100:00100000:1.0:1788839502.042920:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000513b7411 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604032:0@lo:101: 00010000:00010000:1.0:1788839502.042934:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.042942:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839502.044822:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ee9488b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604288:0@lo:256: 00000100:00100000:1.0:1788839502.044889:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.044936:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 000000009286b17a going to sleep for 11 seconds 00000100:00100000:3.0:1788839502.044938:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604288 00000100:00100000:3.0:1788839502.044945:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604288 00000100:00100000:3.0:1788839502.044984:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839502.045020:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001992f0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+13:7418:x1875734060604288:12345-0@lo:256: 20000000:01000000:3.0:1788839502.045049:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788839502.045066:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788839502.045069:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788839502.045168:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001992f0ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+13:7418:x1875734060604288:12345-0@lo:256: Request processed in 157us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839502.045176:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788839502.045226:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ee9488b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604288:0@lo:256: 10000000:01000000:1.0:1788839502.046005:0:7418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839502.046024:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.046045:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839502.046053:0:7418:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab74434b000 from 1 10000000:01000000:1.0:1788839502.046056:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839502.046081:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.046088:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.046095:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839502.046109:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ee9488b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604416:0@lo:101: 00000100:00100000:1.0:1788839502.046267:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.046305:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 000000009286b17a going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.046353:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604416 00000100:00100000:2.0:1788839502.046360:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604416 00000100:00100000:2.0:1788839502.046394:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839502.046401:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f7b1695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+13:7418:x1875734060604416:12345-0@lo:101: 00010000:00010000:2.0:1788839502.046412:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839502.046424:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265727b7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839502.046458:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265727b7 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839502.046466:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727b7 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839502.046473:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cdb49716, rc 0) 00000100:00100000:2.0:1788839502.046517:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f7b1695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:7418:x1875734060604416:12345-0@lo:101: Request processed in 116us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.046534:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788839502.046566:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ee9488b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604416:0@lo:101: 00010000:00010000:0.0:1788839502.046578:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.046586:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839502.046669:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008e11f450 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604544:0@lo:501: 00000100:00100000:0.0:1788839502.046702:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839502.046721:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000893b212d going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.047330:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604544 00000100:00100000:2.0:1788839502.047336:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604544 00000100:00100000:2.0:1788839502.047359:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788839502.047365:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3cd0e71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+14:7418:x1875734060604544:12345-0@lo:501: 00000100:00100000:2.0:1788839502.047461:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3cd0e71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+14:7418:x1875734060604544:12345-0@lo:501: Request processed in 96us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.047467:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839502.047927:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008e11f450 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604544:0@lo:501: 00000100:00100000:1.0:1788839502.047963:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036b71eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604672:0@lo:503: 00000100:00100000:1.0:1788839502.048937:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.048968:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024d50db0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.049192:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604672 00000100:00100000:2.0:1788839502.049199:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604672 00000100:00100000:2.0:1788839502.049235:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788839502.049242:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2ab9890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:7418:x1875734060604672:12345-0@lo:503: 00000040:00080000:2.0:1788839502.049288:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839502.049358:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2ab9890 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:7418:x1875734060604672:12345-0@lo:503: Request processed in 116us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.049365:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839502.049541:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036b71eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604672:0@lo:503: 00000040:00080000:1.0:1788839502.050232:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839502.050279:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788839502.050386:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1788839502.050972:0:6492:0:(import.c:65:import_set_state_nolock()) 000000007f6780c5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839502.051157:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034e766fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060603904:12345-0@lo:38: Request processed in 9181us (10363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839502.051170:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839502.051209:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839502.051217:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788839502.051224:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788839502.051230:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788839502.051232:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000472153b7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839502.051246:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000030c57877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060603904:0@lo:38: 00000100:00100000:3.0:1788839502.052154:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036b71eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060604800:0@lo:41: 00000100:00100000:3.0:1788839502.052204:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.052301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604800 00000100:00100000:1.0:1788839502.052308:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604800 00000100:00100000:1.0:1788839502.052359:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839502.052366:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e029b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060604800:12345-0@lo:41: 00000004:00000024:1.0:1788839502.052392:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788839502.052431:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e029b67 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060604800:12345-0@lo:41: Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839502.052566:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036b71eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060604800:0@lo:41: 00000100:00100000:1.0:1788839502.053521:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:00080000:2.0:1788839502.055252:0:7435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:1.0:1788839502.055747:0:7418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788839502.055815:0:7418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839502.055833:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.055845:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839502.055901:0:7418:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788839502.055904:0:7418:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab74434b000 10000000:01000000:1.0:1788839502.055908:0:7418:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab74434b000 10000000:01000000:1.0:1788839502.055912:0:7418:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839502.055917:0:7418:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab74434b000 from 1 10000000:01000000:1.0:1788839502.055919:0:7418:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839502.055952:0:7418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.055974:0:7418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.055983:0:7418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839502.056252:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000533bb5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604928:0@lo:101: 00000100:00100000:1.0:1788839502.056411:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.057243:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024d50db0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.057383:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060604928 00000100:00100000:2.0:1788839502.057398:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060604928 00000100:00100000:0.0:1788839502.057526:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839502.057536:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000197751fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:7418:x1875734060604928:12345-0@lo:101: 00010000:00010000:0.0:1788839502.057550:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839502.057562:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000db4641e/0xad5b343a265727cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265727c5 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.057584:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000db4641e/0xad5b343a265727cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265727c5 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.057594:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000db4641e/0xad5b343a265727cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727c5 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839502.057601:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000db4641e, rc 0) 00000100:00100000:0.0:1788839502.057649:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000197751fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060604928:12345-0@lo:101: Request processed in 115us (1239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839502.057655:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788839502.057997:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000533bb5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060604928:0@lo:101: 00010000:00010000:1.0:1788839502.058131:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.058141:0:7418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839502.058236:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000533bb5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605056:0@lo:501: 00000100:00100000:1.0:1788839502.058262:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.058279:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024d50db0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839502.058336:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605056 00000100:00100000:0.0:1788839502.058341:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605056 00000100:00100000:0.0:1788839502.058692:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788839502.058699:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041be2bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605056:12345-0@lo:501: 00000100:00100000:0.0:1788839502.058847:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041be2bcf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605056:12345-0@lo:501: Request processed in 149us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839502.058854:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839502.061465:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000533bb5b pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605056:0@lo:501: 00000100:00100000:3.0:1788839502.061526:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605184:0@lo:503: 00000100:00100000:3.0:1788839502.061604:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.064893:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000486d65fd going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.066424:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605184 00000100:00100000:2.0:1788839502.066436:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605184 00000100:00100000:2.0:1788839502.066504:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839502.066512:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6286309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605184:12345-0@lo:503: 00000100:00100000:2.0:1788839502.066672:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6286309 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605184:12345-0@lo:503: Request processed in 160us (5068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.066679:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839502.071843:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605184:0@lo:503: 00000040:00080000:3.0:1788839502.072242:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839502.072342:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605312:0@lo:502: 00000100:00100000:3.0:1788839502.072408:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.072585:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605312 00000100:00100000:1.0:1788839502.072592:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605312 00000100:00100000:1.0:1788839502.072642:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839502.072651:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b223a09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605312:12345-0@lo:502: 00000100:00100000:1.0:1788839502.072750:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b223a09c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605312:12345-0@lo:502: Request processed in 99us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839502.072765:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788839502.073090:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000486d65fd going to sleep for 11 seconds 00000100:00100000:3.0:1788839502.073113:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605312:0@lo:502: 00000040:00080000:3.0:1788839502.073338:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788839502.073366:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788839502.073394:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788839502.073409:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788839502.073420:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788839502.073430:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788839502.076604:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788839502.076727:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788839502.076743:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788839502.076757:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788839502.077011:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788839502.077041:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788839502.077056:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788839502.077070:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788839502.077084:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788839502.077098:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788839502.077110:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788839502.077124:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788839502.077164:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788839502.077180:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788839502.077193:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788839502.077205:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788839502.077216:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788839502.077229:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788839502.077252:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788839502.077267:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788839502.077281:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788839502.077295:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788839502.078719:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605440:0@lo:502: 00000100:00100000:3.0:1788839502.078834:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.078876:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000486d65fd going to sleep for 11 seconds 00000100:00100000:1.0:1788839502.079085:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605440 00000100:00100000:1.0:1788839502.079093:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605440 00000100:00100000:1.0:1788839502.079148:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839502.079156:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095c6cc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605440:12345-0@lo:502: 00000100:00100000:1.0:1788839502.079270:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095c6cc3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605440:12345-0@lo:502: Request processed in 114us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839502.079278:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788839502.079940:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605440:0@lo:502: 00000040:00080000:3.0:1788839502.080037:0:7418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788839502.080050:0:7418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788839502.083927:0:7436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788839502.083946:0:7436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000659a3cbb) 00000020:00000080:3.0:1788839502.083970:0:7436:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788839502.084106:0:7436:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c3cb25c9 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788839502.084111:0:7436:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c3cb25c9 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788839502.084114:0:7436:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c3cb25c9 3 00010000:00080000:3.0:1788839502.084154:0:7436:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000062435a5d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839502.090255:0:7436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788839502.090481:0:7436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788839502.090526:0:7436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839502.090542:0:7436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xad5b343a265727da 00000100:00080000:3.0:1788839502.090553:0:7436:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839502.090558:0:7436:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000062435a5d using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839502.090592:0:7436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000042a889d4 x1875734060605568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839502.090626:0:7436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788839502.090717:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839502.090731:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042ce39cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060605696:0@lo:400: 00000100:00100000:3.0:1788839502.090817:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.090852:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839502.090859:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6b735c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060605824:0@lo:400: 00000100:00100000:3.0:1788839502.090885:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.090919:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605696 00000100:00100000:3.0:1788839502.090925:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605696 00000100:00100000:3.0:1788839502.090960:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839502.090967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000403e9900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060605696:12345-0@lo:400: 00000100:00100000:1.0:1788839502.092671:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060605568:0@lo:38: 00000100:00100000:1.0:1788839502.092721:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839502.094501:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788839502.094514:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788839502.097656:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605568 00000100:00100000:1.0:1788839502.097669:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605568 00000100:00100000:1.0:1788839502.097708:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788839502.097723:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839502.097730:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080e931fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060605568:12345-0@lo:38: 00010000:00080000:1.0:1788839502.097758:0:6488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:1.0:1788839502.097818:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad5b343a265727e1 00000004:00100000:1.0:1788839502.097833:0:6488:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788839502.097860:0:6488:0:(import.c:65:import_set_state_nolock()) 000000000c7ca306 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839502.097927:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080e931fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875734060605568:12345-0@lo:38: Request processed in 198us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839502.097932:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788839502.097963:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042a889d4 x1875734060605568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839512 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839502.097971:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839502.097976:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788839502.097981:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788839502.097985:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788839502.097994:0:3613:0:(import.c:65:import_set_state_nolock()) 0000000062435a5d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788839502.098008:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042a889d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060605568:0@lo:38: 00000100:00100000:3.0:1788839502.099366:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000403e9900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060605696:12345-0@lo:400: Request processed in 8395us (8545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839502.099378:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839502.099409:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605824 00000100:00100000:3.0:1788839502.099415:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605824 00000100:00100000:3.0:1788839502.099461:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839502.099467:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003739a15d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060605824:12345-0@lo:400: 00000100:00100000:3.0:1788839502.099523:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003739a15d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060605824:12345-0@lo:400: Request processed in 57us (8638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839502.099529:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839502.099562:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6b735c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060605824:0@lo:400: 00010000:00080000:2.0:1788839502.100053:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042ce39cf x1875734060605696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839502.100065:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042ce39cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060605696:0@lo:400: 00000040:00080000:3.0:1788839502.103215:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788839502.103846:0:7418:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788839502.103877:0:7418:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839502.103894:0:7418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839502.103905:0:7418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000f1ad82b5/0xad5b343a265727c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839502.103971:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839502.103973:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788839502.103974:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839502.103976:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839502.103977:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839502.103978:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839502.103979:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839502.103980:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839502.103982:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839502.103983:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839502.103985:0:7418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839502.103992:0:7418:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788839502.103994:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839502.103995:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788839502.103996:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839502.103997:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839502.104009:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839502.104010:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839502.104011:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839502.104012:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839502.104013:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839502.104013:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839502.104014:0:7418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839502.104047:0:7418:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788839502.104065:0:7418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023894a62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605952:0@lo:253: 00000100:00100000:2.0:1788839502.104128:0:7418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839502.104167:0:7418:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ebe515b8 going to sleep for 11 seconds 40000000:00080000:1.0:1788839502.105603:0:7439:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:2.0:1788839502.106116:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060605952 00000100:00100000:2.0:1788839502.106125:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060605952 00000100:00100000:2.0:1788839502.106172:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839502.106180:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003523472a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605952:12345-0@lo:253: 20000000:01000000:2.0:1788839502.106208:0:6480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788839502.106221:0:6480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788839502.111740:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788839502.111875:0:6480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788839502.111889:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788839502.112201:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003523472a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:7418:x1875734060605952:12345-0@lo:253: Request processed in 6017us (8068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.112214:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839502.112350:0:7418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023894a62 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:7418:1875734060605952:0@lo:253: 10000000:01000000:0.0:1788839502.112365:0:7418:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788839502.112369:0:7418:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839502.112371:0:7418:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788839502.112372:0:7418:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839502.112373:0:7418:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839502.112374:0:7418:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839502.112375:0:7418:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839502.112376:0:7418:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839502.112377:0:7418:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788839502.112378:0:7418:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788839502.112379:0:7418:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839502.112380:0:7418:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788839502.112395:0:7418:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788839502.117916:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788839502.117925:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788839502.117948:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.117968:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572701 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.117974:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727a2 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.117981:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.118045:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265727a2 expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.118061:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265727a2 expref: 14 pid: 6479 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839502.118076:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6b735c7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060606080:0@lo:104: 00000100:00100000:3.0:1788839502.118136:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839502.118209:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572701 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.118216:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572701 expref: 14 pid: 6480 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839502.118223:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049859851 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060606208:0@lo:104: 00000100:00100000:3.0:1788839502.118246:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.118263:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b605083d going to sleep for 11 seconds 00000100:00100000:3.0:1788839502.118292:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606080 00000100:00100000:3.0:1788839502.118298:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606080 00000100:00100000:2.0:1788839502.118542:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606208 00000100:00100000:2.0:1788839502.118548:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606208 00000100:00100000:3.0:1788839502.118685:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839502.118694:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000025a4a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060606080:12345-0@lo:104: 00010000:00010000:3.0:1788839502.118706:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.118757:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839502.118762:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000025a4a74 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060606080:12345-0@lo:104: Request processed in 70us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839502.118785:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839502.123763:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839502.123799:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042ce39cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060606208:12345-0@lo:104: 00010000:00010000:2.0:1788839502.123818:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839502.123935:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839502.123940:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042ce39cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060606208:12345-0@lo:104: Request processed in 149us (5695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.123948:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839502.124169:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6b735c7 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060606080:0@lo:104: 00000100:00100000:3.0:1788839502.124179:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049859851 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060606208:0@lo:104: 00010000:00010000:3.0:1788839502.124201:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124221:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839502.124226:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124243:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ecbbdc08 already unused, calling callback (000000003cb70707) 10000000:00010000:3.0:1788839502.124246:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124253:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839502.124259:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839502.124265:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839502.124304:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124311:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839502.124449:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124457:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000ecbbdc08/0xad5b343a265727a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727b0 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124469:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839502.124471:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124477:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000629a6efa already unused, calling callback (000000003cb70707) 10000000:00010000:3.0:1788839502.124479:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124494:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839502.124500:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839502.124505:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839502.124517:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124523:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839502.124537:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124542:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000629a6efa/0xad5b343a26572701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572708 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.124557:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839502.124559:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839502.124560:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839502.124566:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839502.124581:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839502.124593:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000049859851 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060606336:0@lo:103: 00080000:10000000:0.0:1788839502.124998:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:3.0:1788839502.125283:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839502.125451:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606336 00000100:00100000:1.0:1788839502.125460:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606336 00000100:00100000:2.0:1788839502.125528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6b735c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060606464:0@lo:103: 00000100:00100000:2.0:1788839502.125560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:0.0:1788839502.126061:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788839502.126290:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788839502.126918:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788839502.127164:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788839502.127311:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788839502.130671:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788839502.130920:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788839502.131463:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788839502.131692:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788839502.131961:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788839502.132708:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00010000:00010000:1.0:1788839502.133223:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727a2 expref: 15 pid: 6479 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839502.133266:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606464 00000100:00100000:1.0:1788839502.133274:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606464 00010000:00010000:1.0:1788839502.133297:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572701 expref: 16 pid: 6480 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839502.133312:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839502.133330:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a889d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+16:3614:x1875734060606336:12345-0@lo:103: 00010000:00010000:1.0:1788839502.133345:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839502.133350:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727a2 expref: 16 pid: 6479 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133362:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265727a2 expref: 16 pid: 6479 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133377:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea3c22b7/0xad5b343a265727b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265727a2 expref: 16 pid: 6479 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133395:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839502.133467:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a889d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+15:3614:x1875734060606336:12345-0@lo:103: Request processed in 148us (8185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839502.133474:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839502.133489:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839502.133503:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa8fc219 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+14:3616:x1875734060606464:12345-0@lo:103: 00010000:00010000:1.0:1788839502.133510:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839502.133514:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572701 expref: 14 pid: 6480 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133522:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572701 expref: 14 pid: 6480 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133532:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e5c3be5f/0xad5b343a26572708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572701 expref: 14 pid: 6480 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133543:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133550:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788839502.133566:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015642370s 00010000:00010000:1.0:1788839502.133569:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133575:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133580:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133585:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133590:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea03fc2f already unused, calling callback (0000000057ea3cd3) 00010000:00010000:1.0:1788839502.133599:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133608:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133632:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839502.133642:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839502.133671:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa8fc219 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+13:3616:x1875734060606464:12345-0@lo:103: Request processed in 170us (8111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839502.133677:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839502.133738:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6b735c7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060606464:0@lo:103: 00000100:00100000:2.0:1788839502.136526:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000049859851 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060606336:0@lo:103: 00010000:00010000:3.0:1788839502.138191:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.138207:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839502.138238:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ea03fc2f/0xad5b343a265727e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1788839502.141809:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1788839502.142149:0:7443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788839502.142164:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788839502.142242:0:7443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7443:1875734060606592:0@lo:700: 00000100:00100000:3.0:1788839502.142314:0:7443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.142365:0:7443:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b605083d going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.142576:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606592 00000100:00100000:2.0:1788839502.142585:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606592 00000100:00100000:2.0:1788839502.142693:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839502.142702:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a12d6f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7443:x1875734060606592:12345-0@lo:700: 00000020:00080000:2.0:1788839502.142817:0:7442:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788839502.142821:0:7442:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788839502.153335:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060606720:0@lo:1000: 00000100:00100000:3.0:1788839502.153408:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.153460:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008039ecb going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.153573:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606720 00000100:00100000:2.0:1788839502.153581:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606720 00000100:00100000:2.0:1788839502.153641:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839502.153649:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049859851 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060606720:12345-0@lo:1000: 00000100:00100000:2.0:1788839502.153735:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049859851 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060606720:12345-0@lo:1000: Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.153752:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:0.0:1788839502.154889:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788839502.154995:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788839502.155451:0:7418:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788839502.155457:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788839502.155580:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839502.156595:0:7418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788839502.157172:0:7418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788839502.157202:0:7418:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788839502.157361:0:7418:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788839502.157557:0:7418:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:3.0:1788839502.159900:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060606720:0@lo:1000: 00000040:01000000:3.0:1788839502.159947:0:7444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1788839502.159992:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060606848:0@lo:700: 00000100:00100000:3.0:1788839502.160075:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.160121:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000004353f3b6 going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.161196:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606848 00000100:00100000:2.0:1788839502.161205:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606848 00000100:00100000:2.0:1788839502.161255:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839502.161263:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6b735c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060606848:12345-0@lo:700: 00000100:00100000:2.0:1788839502.161335:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6b735c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060606848:12345-0@lo:700: Request processed in 73us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.161343:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839502.161542:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060606848:0@lo:700: 00000100:00100000:3.0:1788839502.161602:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7444:1875734060606976:0@lo:900: 00000100:00100000:3.0:1788839502.161642:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.161673:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000004353f3b6 going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.161811:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060606976 00000100:00100000:2.0:1788839502.161816:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060606976 00000100:00100000:2.0:1788839502.161842:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839502.161847:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000284898dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7444:x1875734060606976:12345-0@lo:900: 00000100:00100000:2.0:1788839502.161886:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000284898dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7444:x1875734060606976:12345-0@lo:900: Request processed in 39us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.161893:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788839502.161958:0:7444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000271b07f3 x1875734060606976/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839518 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839502.161970:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7444:1875734060606976:0@lo:900: 00000100:00100000:3.0:1788839502.162061:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060607104:0@lo:1000: 00000100:00100000:3.0:1788839502.162097:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.162119:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 0000000018ae7dcc going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.162212:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060607104 00000100:00100000:2.0:1788839502.162217:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060607104 00000100:00100000:2.0:1788839502.162247:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839502.162254:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb11f188 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060607104:12345-0@lo:1000: 00000100:00100000:2.0:1788839502.162311:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb11f188 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060607104:12345-0@lo:1000: Request processed in 58us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.162318:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839502.162440:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060607104:0@lo:1000: 00000004:00080000:3.0:1788839502.162484:0:7444:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000004353f3b6 with version 0 00000020:00100000:3.0:1788839502.162498:0:7444:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788839502.162503:0:7444:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000271b07f3 x1875734060607360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839502.162515:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060607360:0@lo:1000: 00000100:00100000:3.0:1788839502.162537:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.162558:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000008c13a9a8 going to sleep for 11 seconds 00000100:00100000:2.0:1788839502.162601:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060607360 00000100:00100000:2.0:1788839502.162606:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060607360 00000100:00100000:2.0:1788839502.162641:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839502.162646:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49cc058 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060607360:12345-0@lo:1000: 00100000:10000000:0.0:1788839502.167300:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788839502.167494:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788839502.167807:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788839502.167939:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788839502.168544:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788839502.168767:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788839502.168916:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788839502.169229:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788839502.169509:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788839502.169720:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788839502.169928:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788839502.171163:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788839502.171716:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788839502.172599:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788839502.172834:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000001:00080000:0.0:1788839502.179124:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788839502.180259:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49cc058 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060607360:12345-0@lo:1000: Request processed in 17608us (17716us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788839502.180274:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:0.0:1788839502.180397:0:7444:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788839502.180402:0:7444:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788839502.180418:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000271b07f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060607360:0@lo:1000: 00000100:00100000:0.0:1788839502.180516:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbba4a0e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060607488:0@lo:1000: 00000100:00100000:0.0:1788839502.180561:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839502.180603:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000009d100b08 going to sleep for 11 seconds 00000100:00100000:3.0:1788839502.180761:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060607488 00000100:00100000:3.0:1788839502.180789:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060607488 00000100:00100000:3.0:1788839502.180828:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839502.180835:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000318efaf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060607488:12345-0@lo:1000: 00000100:00100000:3.0:1788839502.180896:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000318efaf3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7444:x1875734060607488:12345-0@lo:1000: Request processed in 62us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839502.180901:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839502.180923:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbba4a0e pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7444:1875734060607488:0@lo:1000: 00000040:00080000:3.0:1788839502.180937:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788839502.180963:0:7444:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000064c7b65b with version 1 00000004:00080000:3.0:1788839502.180978:0:7433:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b036f784 version 1 rpc_version 1 00000020:00100000:3.0:1788839502.180990:0:7433:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788839502.180996:0:7433:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000977a443b x1875734060607744/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839502.181134:0:7433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000977a443b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7433:1875734060607744:0@lo:1000: 00000100:00100000:3.0:1788839502.181159:0:7433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839502.181173:0:7433:0:(client.c:2715:ptlrpc_set_wait()) set 000000001872f124 going to sleep for 11 seconds 00000100:00100000:3.0:1788839502.181184:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060607744 00000100:00100000:3.0:1788839502.181188:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060607744 00000100:00100000:3.0:1788839502.181205:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839502.181209:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000794a07d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7433:x1875734060607744:12345-0@lo:1000: 00100000:10000000:1.0:1788839502.184277:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788839502.184745:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788839502.184921:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788839502.185089:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788839502.185240:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788839502.185378:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788839502.185526:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788839502.185668:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788839502.185849:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788839502.185982:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788839502.186135:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788839502.186265:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788839502.186424:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788839502.186588:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788839502.186718:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788839502.186890:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 40000000:02000000:2.0:1788839502.187894:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:3.0:1788839502.188288:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788839502.188364:0:7444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:0.0:1788839502.194733:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1788839502.194956:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000794a07d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7433:x1875734060607744:12345-0@lo:1000: Request processed in 13742us (13792us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788839502.194969:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:0.0:1788839502.195131:0:7433:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788839502.195136:0:7433:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788839502.195153:0:7433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000977a443b pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7433:1875734060607744:0@lo:1000: 00000100:00100000:2.0:1788839502.202150:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a12d6f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7443:x1875734060606592:12345-0@lo:700: Request processed in 59442us (59829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839502.202165:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788839502.202245:0:7443:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d0903bf x1875734060606592/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788839518 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839502.202261:0:7443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7443:1875734060606592:0@lo:700: 40000000:02000000:3.0:1788839502.202274:0:7443:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:2.0:1788839502.202331:0:7418:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788839502.203299:0:7418:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788839502.214648:0:7418:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788839502.214693:0:7418:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb69881beb988 00100000:10000000:0.0:1788839502.214701:0:7418:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788839502.219737:0:7418:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788839502.219808:0:7418:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788839502.219827:0:7418:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788839502.219845:0:7418:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788839502.220753:0:7418:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839502.220986:0:7418:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1788839502.247672:0:7443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839502.268572:0:7443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788839502.269475:0:7443:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788839502.269481:0:7443:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:3.0:1788839502.655440:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839503.679413:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839504.714063:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839505.728472:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839506.755064:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839507.329251:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060607872:0@lo:41: 00000100:00100000:3.0:1788839507.329342:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839507.330253:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060607872 00000100:00100000:0.0:1788839507.330266:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060607872 00000100:00100000:0.0:1788839507.330329:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839507.330341:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a889d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060607872:12345-0@lo:41: 00000004:00000024:0.0:1788839507.330392:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788839507.330461:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a889d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060607872:12345-0@lo:41: Request processed in 123us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839507.330468:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839507.330752:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f7502979 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060608000:0@lo:400: 00000100:00100000:1.0:1788839507.330817:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839507.330854:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839507.330860:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000533bb5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060608128:0@lo:400: 00000100:00100000:1.0:1788839507.330884:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839507.330915:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608000 00000100:00100000:1.0:1788839507.330920:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608000 00000100:00100000:1.0:1788839507.330950:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839507.330957:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005487a052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+13:3614:x1875734060608000:12345-0@lo:400: 00000100:00100000:1.0:1788839507.331003:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005487a052 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+13:3614:x1875734060608000:12345-0@lo:400: Request processed in 36us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839507.331009:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839507.331041:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608128 00000100:00100000:1.0:1788839507.331044:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608128 00000100:00100000:1.0:1788839507.331070:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839507.331075:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030c57877 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060608128:12345-0@lo:400: 00000100:00100000:0.0:1788839507.332793:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f7502979 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060608000:0@lo:400: 00000100:00100000:3.0:1788839507.333513:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036b71eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060608256:0@lo:400: 00000100:00100000:3.0:1788839507.333591:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839507.333687:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060607872:0@lo:41: 00000100:00100000:2.0:1788839507.333907:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608256 00000100:00100000:2.0:1788839507.333916:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608256 00000100:00100000:2.0:1788839507.333964:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839507.333972:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000977a443b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060608256:12345-0@lo:400: 00000100:00100000:2.0:1788839507.334042:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000977a443b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060608256:12345-0@lo:400: Request processed in 71us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839507.334050:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788839507.337317:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000036b71eb4 x1875734060608256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839507.337343:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036b71eb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060608256:0@lo:400: 00000100:00100000:0.0:1788839507.343325:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030c57877 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060608128:12345-0@lo:400: Request processed in 12238us (12428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839507.343354:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788839507.343453:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000533bb5b x1875734060608128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839507.343480:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000533bb5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060608128:0@lo:400: 00010000:00010000:1.0:1788839507.775229:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839508.799714:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839508.893891:0:7689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1788839509.375936:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839509.375944:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab74434b000 from 4 10000000:01000000:2.0:1788839509.375948:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839509.376014:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.376027:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.376037:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.376082:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000190e70d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608384:0@lo:101: 00000100:00100000:2.0:1788839509.376172:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.376225:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fc9421f going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.376252:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608384 00000100:00100000:2.0:1788839509.376259:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608384 00000100:00100000:2.0:1788839509.376313:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788839509.376321:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021285141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+13:6483:x1875734060608384:12345-0@lo:101: 00010000:00010000:2.0:1788839509.376335:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839509.376347:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095f8b596/0xad5b343a265727f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265727ef expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.376387:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095f8b596/0xad5b343a265727f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265727ef expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.376398:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095f8b596/0xad5b343a265727f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727ef expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.376406:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095f8b596, rc 0) 00000100:00100000:2.0:1788839509.376456:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021285141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+14:6483:x1875734060608384:12345-0@lo:101: Request processed in 135us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.376462:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788839509.376510:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000190e70d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608384:0@lo:101: 00010000:00010000:2.0:1788839509.376522:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.376531:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.376592:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000190e70d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608512:0@lo:256: 00000100:00100000:2.0:1788839509.376622:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.376649:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fc9421f going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.376662:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608512 00000100:00100000:2.0:1788839509.376665:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608512 00000100:00100000:2.0:1788839509.376687:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788839509.376693:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b51b43a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+14:6483:x1875734060608512:12345-0@lo:256: 20000000:01000000:2.0:1788839509.377189:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788839509.377207:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788839509.377210:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788839509.377306:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b51b43a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+14:6483:x1875734060608512:12345-0@lo:256: Request processed in 614us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.377313:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839509.377395:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000190e70d7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608512:0@lo:256: 10000000:01000000:1.0:1788839509.377454:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839509.377461:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.377477:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000024e8f36c/0xad5b343a265727ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839509.377486:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788839509.377488:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab745341000 from 21 10000000:01000000:1.0:1788839509.377490:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839509.377510:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.377516:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.377522:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839509.377535:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ee9488b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608640:0@lo:101: 00000100:00100000:1.0:1788839509.377564:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839509.377592:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000346b695a going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.377809:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608640 00000100:00100000:2.0:1788839509.377815:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608640 00000100:00100000:2.0:1788839509.377847:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839509.377853:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec729550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:6483:x1875734060608640:12345-0@lo:101: 00010000:00010000:2.0:1788839509.377861:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839509.377872:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010c42b7e/0xad5b343a26572804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265727fd expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.377890:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010c42b7e/0xad5b343a26572804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265727fd expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.377898:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010c42b7e/0xad5b343a26572804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727fd expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.377914:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010c42b7e, rc 0) 00000100:00100000:2.0:1788839509.377946:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec729550 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060608640:12345-0@lo:101: Request processed in 93us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.377951:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839509.378161:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ee9488b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608640:0@lo:101: 00010000:00010000:2.0:1788839509.378173:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.378180:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.378242:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001f092204 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608768:0@lo:501: 00000100:00100000:2.0:1788839509.378266:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.378287:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000088a113e1 going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.378298:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608768 00000100:00100000:2.0:1788839509.378301:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608768 00000100:00100000:2.0:1788839509.378323:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788839509.378329:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003efce14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060608768:12345-0@lo:501: 00000100:00100000:2.0:1788839509.378625:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003efce14a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060608768:12345-0@lo:501: Request processed in 296us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.378642:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839509.384809:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001f092204 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608768:0@lo:501: 00000100:00100000:1.0:1788839509.384881:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608896:0@lo:503: 00000100:00100000:1.0:1788839509.384986:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839509.385021:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffb215f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.387928:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060608896 00000100:00100000:2.0:1788839509.387942:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060608896 00000100:00100000:2.0:1788839509.388036:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788839509.388045:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6aa0c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060608896:12345-0@lo:503: 00000100:00100000:2.0:1788839509.388372:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6aa0c8d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060608896:12345-0@lo:503: Request processed in 327us (3393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.388385:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839509.388538:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060608896:0@lo:503: 00000100:00100000:0.0:1788839509.389735:0:7711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b05012d pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7711:1875734060609024:0@lo:502: 00000100:00100000:0.0:1788839509.389846:0:7711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839509.389885:0:7711:0:(client.c:2715:ptlrpc_set_wait()) set 00000000865716ac going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.390203:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609024 00000100:00100000:2.0:1788839509.390210:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609024 00000100:00100000:2.0:1788839509.390255:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839509.390263:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2f10482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7711:x1875734060609024:12345-0@lo:502: 00000100:00100000:2.0:1788839509.390392:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2f10482 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:7711:x1875734060609024:12345-0@lo:502: Request processed in 130us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.390400:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839509.391156:0:7711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b05012d pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7711:1875734060609024:0@lo:502: 00000100:00100000:1.0:1788839509.391224:0:7711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7711:1875734060609152:0@lo:502: 00000100:00100000:1.0:1788839509.391273:0:7711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839509.391312:0:7711:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffb215f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.391534:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609152 00000100:00100000:2.0:1788839509.391540:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609152 00000100:00100000:2.0:1788839509.391580:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839509.391587:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1b70f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:7711:x1875734060609152:12345-0@lo:502: 00000100:00100000:2.0:1788839509.391695:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1b70f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:7711:x1875734060609152:12345-0@lo:502: Request processed in 109us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.391702:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788839509.392028:0:7711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7711:1875734060609152:0@lo:502: 00000040:00080000:1.0:1788839509.392053:0:7711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788839509.392995:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788839509.393027:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839509.393038:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.393051:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000a41b3505/0xad5b343a265727fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839509.393062:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839509.393065:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab745341000 from 4 10000000:01000000:2.0:1788839509.393068:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839509.393225:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.393250:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.393258:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.393279:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000122c9a4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609280:0@lo:101: 00000100:00100000:2.0:1788839509.393334:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.393381:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000009fc9421f going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.393531:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609280 00000100:00100000:0.0:1788839509.393538:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609280 00000100:00100000:0.0:1788839509.393585:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788839509.393593:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dd1be3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060609280:12345-0@lo:101: 00010000:00010000:0.0:1788839509.393605:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839509.393617:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f3c04d3f/0xad5b343a26572812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657280b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839509.393651:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f3c04d3f/0xad5b343a26572812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657280b expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839509.393660:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f3c04d3f/0xad5b343a26572812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657280b expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839509.393667:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f3c04d3f, rc 0) 00000100:00100000:0.0:1788839509.393866:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dd1be3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060609280:12345-0@lo:101: Request processed in 272us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.393873:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839509.394010:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000122c9a4a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609280:0@lo:101: 00010000:00010000:1.0:1788839509.394025:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.394034:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839509.394090:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609408:0@lo:256: 00000100:00100000:1.0:1788839509.394256:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839509.394279:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ffb215f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.394338:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609408 00000100:00100000:2.0:1788839509.394343:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609408 00000100:00100000:2.0:1788839509.394382:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839509.394388:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002700db8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060609408:12345-0@lo:256: 20000000:01000000:2.0:1788839509.394406:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788839509.394625:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788839509.394787:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788839509.394877:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002700db8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060609408:12345-0@lo:256: Request processed in 489us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.394885:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839509.394926:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d831f03 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609408:0@lo:256: 10000000:01000000:2.0:1788839509.395283:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788839509.395293:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.395302:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000082741dd7/0xad5b343a2657280b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839509.395325:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788839509.395327:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788839509.395331:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788839509.395357:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.395365:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.395373:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.395389:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093132fb8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609536:0@lo:101: 00000100:00100000:2.0:1788839509.395420:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.396092:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3d2aba0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839509.396189:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609536 00000100:00100000:1.0:1788839509.396196:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609536 00000100:00100000:1.0:1788839509.396280:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839509.396287:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000dbe7f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060609536:12345-0@lo:101: 00010000:00010000:1.0:1788839509.396300:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839509.396313:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce508a0f/0xad5b343a26572820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572819 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.396335:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce508a0f/0xad5b343a26572820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572819 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.396343:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce508a0f/0xad5b343a26572820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572819 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839509.396350:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce508a0f, rc 0) 00000100:00100000:1.0:1788839509.396385:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000dbe7f5b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060609536:12345-0@lo:101: Request processed in 99us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839509.396399:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788839509.396463:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093132fb8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609536:0@lo:101: 00010000:00010000:2.0:1788839509.396475:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.396483:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.396541:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093132fb8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609664:0@lo:501: 00000100:00100000:2.0:1788839509.396567:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839509.409714:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609664 00000100:00100000:0.0:1788839509.409731:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609664 00000100:00100000:0.0:1788839509.410168:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839509.410177:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e86df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060609664:12345-0@lo:501: 00000100:00100000:0.0:1788839509.410455:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e86df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060609664:12345-0@lo:501: Request processed in 279us (13887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.410477:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788839509.411076:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3d2aba0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839509.411112:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093132fb8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609664:0@lo:501: 00000100:00100000:3.0:1788839509.411161:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609792:0@lo:503: 00000100:00100000:3.0:1788839509.411207:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.411224:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093cc4b48 going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.411524:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609792 00000100:00100000:0.0:1788839509.411530:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609792 00000100:00100000:0.0:1788839509.411567:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788839509.411574:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009fd0965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060609792:12345-0@lo:503: 00000100:00100000:0.0:1788839509.415781:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009fd0965 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060609792:12345-0@lo:503: Request processed in 4187us (4553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.415799:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788839509.424601:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002d0903bf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060609792:0@lo:503: 00000100:00100000:1.0:1788839509.428400:0:7712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a2cfa46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7712:1875734060609920:0@lo:502: 00000100:00100000:1.0:1788839509.428506:0:7712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839509.428545:0:7712:0:(client.c:2715:ptlrpc_set_wait()) set 00000000346b695a going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.428687:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060609920 00000100:00100000:2.0:1788839509.428704:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060609920 00000100:00100000:2.0:1788839509.428752:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839509.428760:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb9ea236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:7712:x1875734060609920:12345-0@lo:502: 00000100:00100000:2.0:1788839509.428902:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb9ea236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:7712:x1875734060609920:12345-0@lo:502: Request processed in 143us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.428910:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788839509.429040:0:7712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a2cfa46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7712:1875734060609920:0@lo:502: 00000020:01000000:1.0:1788839509.429071:0:7712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839509.429084:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839509.429086:0:7712:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788839509.429091:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788839509.429105:0:7712:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:1.0:1788839509.429131:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839509.429144:0:7712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000aa6d7743) 00000020:00000080:1.0:1788839509.429164:0:7712:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788839509.429168:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788839509.429260:0:7712:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788839509.429265:0:7712:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788839509.429273:0:7712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a2657282e 00010000:00080000:1.0:1788839509.429300:0:7712:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d614078f@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839509.430964:0:7712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788839509.440555:0:7712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788839509.440573:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788839509.441325:0:7712:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788839509.441356:0:7712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26572835 00000100:00080000:0.0:1788839509.441368:0:7712:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788839509.441373:0:7712:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d614078f using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839509.441411:0:7712:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bf5a970b x1875734060610048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839509.446696:0:7712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788839509.446761:0:7712:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788839509.449571:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060f08e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060610176:0@lo:400: 00000100:00100000:3.0:1788839509.449735:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.450022:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf5a970b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060610048:0@lo:38: 00000100:00100000:2.0:1788839509.450062:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.450537:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610176 00000100:00100000:3.0:1788839509.450545:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610176 00000100:00100000:3.0:1788839509.450596:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839509.450604:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000271b07f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060610176:12345-0@lo:400: 00000100:00100000:3.0:1788839509.451092:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000271b07f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060610176:12345-0@lo:400: Request processed in 489us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839509.451101:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839509.451130:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009d7f229 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060610304:0@lo:400: 00000100:00100000:3.0:1788839509.451162:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.451186:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839509.451191:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ed59644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060610432:0@lo:400: 00000100:00100000:3.0:1788839509.451240:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788839509.451285:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000060f08e5b x1875734060610176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839509.451302:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060f08e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060610176:0@lo:400: 00000100:00100000:0.0:1788839509.451450:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610048 00000100:00100000:0.0:1788839509.451456:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610048 00000100:00100000:0.0:1788839509.451473:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610304 00000100:00100000:0.0:1788839509.451475:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610304 00000100:00100000:0.0:1788839509.451493:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839509.451498:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a10e867a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060610048:12345-0@lo:38: 00010000:00080000:0.0:1788839509.451522:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1788839509.451559:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a2657283c 00000004:00100000:0.0:1788839509.451575:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788839509.451587:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788839509.451665:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610432 00000100:00100000:3.0:1788839509.451669:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610432 00000100:00100000:3.0:1788839509.451694:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839509.451699:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000992bfc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060610432:12345-0@lo:400: 00000100:00100000:3.0:1788839509.451734:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000992bfc8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060610432:12345-0@lo:400: Request processed in 35us (493us total) trans 0 rc 0/0 00000020:01000000:0.0:1788839509.451736:0:7712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788839509.451740:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:00000080:0.0:1788839509.451743:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839509.451745:0:7712:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788839509.451748:0:7712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839509.451752:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839509.451754:0:7712:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788839509.451756:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788839509.451758:0:7712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00010000:00080000:3.0:1788839509.451763:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006ed59644 x1875734060610432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839509.451788:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ed59644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060610432:0@lo:400: 00000100:00100000:0.0:1788839509.451805:0:7712:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a72b876 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7712:1875734060610688:0@lo:502: 00000100:00100000:0.0:1788839509.451851:0:7712:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839509.451860:0:7715:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000061dc6152 x1875734060610560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839509.451872:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b2a6dbe going to sleep for 0 seconds 00000100:00100000:0.0:1788839509.451873:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610688 00000100:00100000:0.0:1788839509.451876:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610688 00000100:00100000:0.0:1788839509.451900:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839509.451906:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000719b33cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:7712:x1875734060610688:12345-0@lo:502: 00000100:00100000:0.0:1788839509.452010:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000719b33cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:7712:x1875734060610688:12345-0@lo:502: Request processed in 104us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.452018:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839509.452066:0:7712:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c31532a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.452080:0:7712:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a72b876 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:7712:1875734060610688:0@lo:502: 00000020:01000000:0.0:1788839509.452104:0:7712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839509.452109:0:7712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839509.452110:0:7712:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788839509.452113:0:7712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788839509.452297:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788839509.452322:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788839509.452332:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.452342:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000795589e5/0xad5b343a26572819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839509.452351:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788839509.452353:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab7486e8000 from 1 10000000:01000000:2.0:1788839509.452356:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788839509.452379:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.452496:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839509.452505:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839509.452519:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008554ec6f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060610816:0@lo:101: 00000100:00100000:2.0:1788839509.452554:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.452747:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2f54544 going to sleep for 11 seconds 00000100:00100000:3.0:1788839509.452820:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610816 00000100:00100000:3.0:1788839509.452825:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610816 00000100:00100000:3.0:1788839509.452860:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788839509.452867:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080084cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060610816:12345-0@lo:101: 00010000:00010000:3.0:1788839509.452876:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839509.452888:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008be9d29f/0xad5b343a2657284a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572843 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839509.452909:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008be9d29f/0xad5b343a2657284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572843 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839509.452917:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008be9d29f/0xad5b343a2657284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572843 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839509.452926:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008be9d29f, rc 0) 00000100:00100000:3.0:1788839509.452956:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080084cfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060610816:12345-0@lo:101: Request processed in 90us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839509.452963:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788839509.453014:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008554ec6f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060610816:0@lo:101: 00010000:00010000:3.0:1788839509.453025:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839509.453032:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839509.453079:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060610944:0@lo:501: 00000100:00100000:3.0:1788839509.453103:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.453121:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 000000002d145879 going to sleep for 11 seconds 00000100:00100000:3.0:1788839509.453132:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610944 00000100:00100000:3.0:1788839509.453135:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610944 00000100:00100000:3.0:1788839509.453154:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788839509.453159:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021941c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060610944:12345-0@lo:501: 00000100:00100000:3.0:1788839509.453293:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021941c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060610944:12345-0@lo:501: Request processed in 133us (189us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839509.453299:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788839509.453320:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060610944:0@lo:501: 10000000:01000000:3.0:1788839509.453339:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788839509.453344:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839509.453350:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000000ea90501/0xad5b343a26572843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788839509.470324:0:6492:0:(import.c:65:import_set_state_nolock()) 000000002e584b5e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839509.470432:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a10e867a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060610048:12345-0@lo:38: Request processed in 18931us (20369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.470445:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839509.470473:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839509.470491:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d0903bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060610304:12345-0@lo:400: 00000100:00100000:2.0:1788839509.470505:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839509.470514:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788839509.470522:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788839509.470528:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788839509.470530:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000d614078f lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839509.470542:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d0903bf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060610304:12345-0@lo:400: Request processed in 56us (19381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.470549:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788839509.470550:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004b2a6dbe): req@0000000061dc6152 x1875734060610560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839509.470566:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf5a970b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060610048:0@lo:38: 00000100:00100000:2.0:1788839509.470644:0:7715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.470687:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b2a6dbe going to sleep for 11 seconds 00000100:00100000:3.0:1788839509.470810:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009d7f229 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060610304:0@lo:400: 00000100:00100000:0.0:1788839509.470882:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060610560 00000100:00100000:0.0:1788839509.470888:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060610560 00000100:00100000:0.0:1788839509.470928:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839509.470935:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0830ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060610560:12345-0@lo:1000: 00000100:00100000:0.0:1788839509.471028:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0830ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060610560:12345-0@lo:1000: Request processed in 93us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.471035:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839509.471103:0:7715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061dc6152 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060610560:0@lo:1000: 00000040:01000000:3.0:1788839509.471143:0:7715:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788839509.471183:0:7715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611072:0@lo:1000: 00000100:00100000:3.0:1788839509.471229:0:7715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.471251:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096d454d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.471466:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060611072 00000100:00100000:0.0:1788839509.471470:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060611072 00000100:00100000:0.0:1788839509.471490:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839509.471495:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e23f3282 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611072:12345-0@lo:1000: 00000100:00100000:0.0:1788839509.471622:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e23f3282 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611072:12345-0@lo:1000: Request processed in 127us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.471629:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839509.472127:0:7715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611072:0@lo:1000: 00000100:00100000:3.0:1788839509.472172:0:7715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611200:0@lo:700: 00000100:00100000:3.0:1788839509.472200:0:7715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.472234:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 00000000208b236d going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.472493:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060611200 00000100:00100000:0.0:1788839509.472498:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060611200 00000100:00100000:0.0:1788839509.472534:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839509.472540:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7c8e006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611200:12345-0@lo:700: 00000100:00100000:0.0:1788839509.472588:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7c8e006 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611200:12345-0@lo:700: Request processed in 48us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.472594:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839509.472765:0:7715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611200:0@lo:700: 00000100:00100000:3.0:1788839509.472926:0:7715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611328:0@lo:1000: 00000100:00100000:3.0:1788839509.472952:0:7715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.473301:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 00000000230439df going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.474135:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060611328 00000100:00100000:0.0:1788839509.474144:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060611328 00000100:00100000:0.0:1788839509.474323:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839509.474331:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005839ff46 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611328:12345-0@lo:1000: 00000100:00100000:0.0:1788839509.474451:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005839ff46 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611328:12345-0@lo:1000: Request processed in 121us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.474457:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839509.474611:0:7715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611328:0@lo:1000: 00000004:00080000:3.0:1788839509.474673:0:7715:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000208b236d with version 0 00000020:00100000:3.0:1788839509.474694:0:7715:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788839509.474700:0:7715:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003ec34a2c x1875734060611584/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839509.474718:0:7715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611584:0@lo:1000: 00000100:00100000:3.0:1788839509.474748:0:7715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.474901:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ffaf9fb going to sleep for 11 seconds 00000100:00100000:2.0:1788839509.474939:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060611584 00000100:00100000:2.0:1788839509.474945:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060611584 00000100:00100000:2.0:1788839509.474988:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839509.474995:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec528c52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611584:12345-0@lo:1000: 00000100:00100000:2.0:1788839509.477428:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a2cfa46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060611712:0@lo:41: 00000100:00100000:2.0:1788839509.477501:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1788839509.478674:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788839509.478686:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788839509.479088:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060611712 00000100:00100000:0.0:1788839509.479099:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060611712 00000100:00100000:1.0:1788839509.482120:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec528c52 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7715:x1875734060611584:12345-0@lo:1000: Request processed in 7118us (7364us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788839509.482136:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839509.482665:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839509.482679:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcf18469 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060611712:12345-0@lo:41: 00000004:00000024:2.0:1788839509.482723:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788839509.482819:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcf18469 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060611712:12345-0@lo:41: Request processed in 146us (5318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839509.482826:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839509.484093:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788839509.484112:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a2cfa46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060611712:0@lo:41: 00000004:00080000:3.0:1788839509.484569:0:7715:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788839509.484584:0:7715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611584:0@lo:1000: 00000100:00100000:3.0:1788839509.484689:0:7715:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611840:0@lo:1000: 00000100:00100000:3.0:1788839509.484758:0:7715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839509.484809:0:7715:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096d454d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.484813:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060611840 00000100:00100000:0.0:1788839509.484820:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060611840 00000100:00100000:0.0:1788839509.484869:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839509.484877:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000288079b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7715:x1875734060611840:12345-0@lo:1000: 00000100:00100000:0.0:1788839509.484959:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000288079b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7715:x1875734060611840:12345-0@lo:1000: Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839509.484965:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839509.485067:0:7715:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7715:1875734060611840:0@lo:1000: 00000040:00080000:3.0:1788839509.485083:0:7715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788839509.485180:0:7715:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000208b236d with version 1 00000040:00080000:3.0:1788839509.487213:0:7715:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788839509.487296:0:7715:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788839509.487302:0:7715:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:2.0:1788839509.488024:0:7713:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bdf7bf03 version 1 rpc_version 1 00000020:00100000:2.0:1788839509.488070:0:7713:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788839509.488164:0:7713:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000cdeb79b3 x1875734060612096/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839509.488187:0:7713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cdeb79b3 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7713:1875734060612096:0@lo:1000: 00000100:00100000:2.0:1788839509.488373:0:7713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839509.488564:0:7713:0:(client.c:2715:ptlrpc_set_wait()) set 00000000492411c1 going to sleep for 11 seconds 00000100:00100000:0.0:1788839509.488725:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612096 00000100:00100000:0.0:1788839509.488733:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612096 00000100:00100000:0.0:1788839509.488854:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839509.488864:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e81e813 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7713:x1875734060612096:12345-0@lo:1000: 00000001:00080000:2.0:1788839509.494314:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788839509.497590:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e81e813 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7713:x1875734060612096:12345-0@lo:1000: Request processed in 6543us (7032us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788839509.497615:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:2.0:1788839509.498704:0:7713:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788839509.498712:0:7713:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788839509.498732:0:7713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cdeb79b3 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7713:1875734060612096:0@lo:1000: 00010000:00010000:1.0:1788839509.823072:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788839510.119620:0:7746:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839510.119846:0:7746:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839510.862918:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839511.871411:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839512.449922:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839512.449948:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060612224:0@lo:41: 00000100:00100000:2.0:1788839512.450061:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839512.450108:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612224 00000100:00100000:3.0:1788839512.450116:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612224 00000100:00100000:3.0:1788839512.450183:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839512.450192:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdeb79b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060612224:12345-0@lo:41: 00000004:00000024:3.0:1788839512.450224:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788839512.450278:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdeb79b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060612224:12345-0@lo:41: Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839512.450284:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839512.450333:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ec34a2c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060612224:0@lo:41: 00010000:00010000:1.0:1788839512.899745:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788839513.522182:0:7847:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839513.522481:0:7847:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788839513.919815:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839514.497510:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008554ec6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060612608:0@lo:400: 00000100:00100000:2.0:1788839514.497584:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839514.497652:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839514.497658:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ed59644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060612736:0@lo:400: 00000100:00100000:2.0:1788839514.497680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839514.497715:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612608 00000100:00100000:2.0:1788839514.497721:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612608 00000100:00100000:2.0:1788839514.497765:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839514.497795:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093132fb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060612608:12345-0@lo:400: 00000100:00100000:2.0:1788839514.497862:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093132fb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060612608:12345-0@lo:400: Request processed in 69us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839514.497868:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839514.497899:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612736 00000100:00100000:2.0:1788839514.497903:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612736 00000100:00100000:2.0:1788839514.497929:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839514.497935:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000122c9a4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060612736:12345-0@lo:400: 00000100:00100000:2.0:1788839514.497978:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000122c9a4a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060612736:12345-0@lo:400: Request processed in 44us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839514.497984:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788839514.498020:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006ed59644 x1875734060612736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839514.498033:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ed59644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060612736:0@lo:400: 00000100:00100000:2.0:1788839514.498042:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008554ec6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060612608:0@lo:400: 00000100:00100000:0.0:1788839514.499082:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061dc6152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060612352:0@lo:400: 00000100:00100000:0.0:1788839514.499138:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839514.499175:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060f08e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060612864:0@lo:400: 00000100:00100000:0.0:1788839514.499201:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839514.499224:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839514.499243:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009d7f229 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060612480:0@lo:400: 00000100:00100000:0.0:1788839514.499270:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839514.499304:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612864 00000100:00100000:0.0:1788839514.499325:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612864 00000100:00100000:0.0:1788839514.499353:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839514.499360:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a72b876 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060612864:12345-0@lo:400: 00000100:00100000:0.0:1788839514.499407:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a72b876 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060612864:12345-0@lo:400: Request processed in 48us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839514.499413:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839514.499433:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612352 00000100:00100000:0.0:1788839514.499436:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612352 00000100:00100000:0.0:1788839514.499468:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788839514.499475:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e7bddd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:3614:x1875734060612352:12345-0@lo:400: 00000100:00100000:0.0:1788839514.499505:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e7bddd6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:3614:x1875734060612352:12345-0@lo:400: Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839514.499512:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788839514.499538:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612480 00000100:00100000:0.0:1788839514.499542:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612480 00000100:00100000:0.0:1788839514.499575:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839514.499581:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e20f6be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060612480:12345-0@lo:400: 00000100:00100000:0.0:1788839514.499608:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e20f6be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060612480:12345-0@lo:400: Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839514.499613:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788839514.499652:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000009d7f229 x1875734060612480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839514.499664:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009d7f229 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060612480:0@lo:400: 00000100:00100000:0.0:1788839514.499672:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061dc6152 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060612352:0@lo:400: 00000100:00100000:0.0:1788839514.499688:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060f08e5b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060612864:0@lo:400: 00000100:00100000:0.0:1788839514.499702:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839514.499707:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008554ec6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060612992:0@lo:41: 00000100:00100000:0.0:1788839514.499728:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839514.499815:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060612992 00000100:00100000:2.0:1788839514.499819:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060612992 00000100:00100000:2.0:1788839514.499853:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839514.499860:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000724e52f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060612992:12345-0@lo:41: 00000004:00000024:2.0:1788839514.499884:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788839514.499925:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000724e52f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060612992:12345-0@lo:41: Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839514.499932:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839514.499975:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008554ec6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060612992:0@lo:41: 00000020:00000080:3.0:1788839514.623436:0:7896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff657621d0 20000000:00000080:3.0:1788839514.623455:0:7896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab777ac0c00 uarg=0000000000000000 20000000:01000000:3.0:1788839514.623495:0:7896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788839514.623502:0:7896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788839514.623507:0:7896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788839514.623877:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788839514.623891:0:7896:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788839514.627238:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839514.627502:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788839514.627535:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788839514.627560:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788839514.627577:0:7896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788839514.627594:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.627612:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265726c9 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.627619:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727b7 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.627625:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.627664:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265727b7 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.627676:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265727b7 expref: 17 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839514.627687:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006601e7dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875734060613120:0@lo:104: 00000100:00100000:3.0:1788839514.627741:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839514.628177:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265726c9 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.628186:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265726c9 expref: 17 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839514.628193:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875734060613248:0@lo:104: 00000100:00100000:3.0:1788839514.628372:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set 000000006c3241c5 going to sleep for 11 seconds 00000100:00100000:0.0:1788839514.628697:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788839514.628717:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839514.628745:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613120 00000100:00100000:0.0:1788839514.628752:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613120 00000100:00100000:0.0:1788839514.628814:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613248 00000100:00100000:0.0:1788839514.628817:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613248 00000100:00100000:0.0:1788839514.628832:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839514.628839:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009db658ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:7896:x1875734060613120:12345-0@lo:104: 00010000:00010000:0.0:1788839514.628851:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839514.628901:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839514.628906:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009db658ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:7896:x1875734060613120:12345-0@lo:104: Request processed in 68us (1164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839514.628912:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788839514.628965:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788839514.628968:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788839514.628971:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839514.628973:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceedba40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:7896:x1875734060613248:12345-0@lo:104: 00010000:00010000:1.0:1788839514.628980:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000030e6f8cf already unused, calling callback (000000003cb70707) 00010000:00010000:0.0:1788839514.628981:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839514.628983:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.628990:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839514.628997:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839514.629003:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839514.629006:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839514.629010:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceedba40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:7896:x1875734060613248:12345-0@lo:104: Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839514.629015:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:1.0:1788839514.629028:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629034:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839514.629051:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629056:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 0000000030e6f8cf/0xad5b343a265727b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727be expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629069:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839514.629071:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629085:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba0fe646 already unused, calling callback (000000003cb70707) 10000000:00010000:1.0:1788839514.629088:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629094:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839514.629099:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839514.629103:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839514.629116:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629122:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839514.629127:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629133:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000ba0fe646/0xad5b343a265726c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265726d0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839514.629147:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839514.629148:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839514.629150:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839514.629193:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006601e7dd pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875734060613120:0@lo:104: 00010000:00010000:2.0:1788839514.629233:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839514.629246:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099005753 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060613376:0@lo:103: 00000100:00100000:2.0:1788839514.629279:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839514.629283:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875734060613248:0@lo:104: 00010000:00010000:3.0:1788839514.629300:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839514.629312:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839514.629317:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e2a4d62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060613504:0@lo:103: 00000100:00100000:2.0:1788839514.629362:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839514.629403:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613376 00000100:00100000:2.0:1788839514.629407:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613376 00010000:00010000:2.0:1788839514.629426:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727b7 expref: 18 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839514.629444:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613504 00000100:00100000:2.0:1788839514.629447:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613504 00010000:00010000:2.0:1788839514.629456:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265726c9 expref: 19 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839514.629468:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839514.629473:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008554ec6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+19:3616:x1875734060613376:12345-0@lo:103: 00010000:00010000:2.0:1788839514.629481:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839514.629485:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727b7 expref: 19 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629493:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265727b7 expref: 19 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629504:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cdb49716/0xad5b343a265727be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265727b7 expref: 19 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629516:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839514.629542:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008554ec6f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+18:3616:x1875734060613376:12345-0@lo:103: Request processed in 69us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839514.629548:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839514.629559:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839514.629564:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ed59644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+17:3616:x1875734060613504:12345-0@lo:103: 00010000:00010000:2.0:1788839514.629571:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839514.629573:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265726c9 expref: 17 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629586:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265726c9 expref: 17 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629594:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000286625f7/0xad5b343a265726d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265726c9 expref: 17 pid: 6479 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629604:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629609:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629621:0:6472:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629626:0:6472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629631:0:6472:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629636:0:6472:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629641:0:6472:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e3ab414 already unused, calling callback (0000000057ea3cd3) 00010000:00010000:2.0:1788839514.629644:0:6472:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629651:0:6472:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629670:0:6472:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839514.629676:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839514.629697:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ed59644 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+16:3616:x1875734060613504:12345-0@lo:103: Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839514.629702:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839514.629729:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e2a4d62 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060613504:0@lo:103: 00000100:00100000:2.0:1788839514.629735:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099005753 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060613376:0@lo:103: 00010000:00010000:3.0:1788839514.630074:0:7896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.630082:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839514.630088:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e3ab414/0xad5b343a26572851 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839514.944642:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839515.968160:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839516.994654:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839517.578726:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839517.578751:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060613632:0@lo:41: 00000100:00100000:3.0:1788839517.578853:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839517.579156:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613632 00000100:00100000:3.0:1788839517.579164:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613632 00000100:00100000:3.0:1788839517.579217:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839517.579224:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006601e7dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060613632:12345-0@lo:41: 00000004:00000024:3.0:1788839517.579261:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788839517.579306:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006601e7dd pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060613632:12345-0@lo:41: Request processed in 82us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839517.579313:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839517.579350:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060613632:0@lo:41: 00010000:00010000:0.0:1788839518.020481:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839519.043437:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788839519.615548:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839519.615558:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab74434b000 from 1 10000000:01000000:3.0:1788839519.615564:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839519.615614:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000ea03fc2f/0xad5b343a26572858 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839519.615636:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000ea03fc2f/0xad5b343a26572858 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839519.615646:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000ea03fc2f/0xad5b343a26572858 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839519.615669:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060613760:0@lo:101: 00000100:00100000:3.0:1788839519.615740:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839519.615961:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613760 00000100:00100000:2.0:1788839519.615969:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613760 00000100:00100000:2.0:1788839519.616020:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788839519.616038:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000db219647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060613760:12345-0@lo:101: 00010000:00010000:2.0:1788839519.616053:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839519.616067:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b53159d8/0xad5b343a2657285f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572858 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839519.616090:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b53159d8/0xad5b343a2657285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572858 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839519.616099:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b53159d8/0xad5b343a2657285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572858 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839519.616106:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b53159d8, rc 0) 00000100:00100000:2.0:1788839519.616146:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000db219647 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060613760:12345-0@lo:101: Request processed in 109us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.616152:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839519.616409:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839519.616421:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000618d7068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060613888:0@lo:41: 00000100:00100000:1.0:1788839519.616460:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.616701:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b854bfff going to sleep for 11 seconds 00000100:00100000:3.0:1788839519.616723:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060613760:0@lo:101: 00010000:00010000:3.0:1788839519.616738:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000ea03fc2f/0xad5b343a26572858 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839519.616746:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000ea03fc2f/0xad5b343a26572858 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839519.617148:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060614016:0@lo:501: 00000100:00100000:3.0:1788839519.617181:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.617207:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b854bfff going to sleep for 11 seconds 00000100:00100000:3.0:1788839519.617276:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060613888 00000100:00100000:3.0:1788839519.617282:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060613888 00000100:00100000:3.0:1788839519.617318:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839519.617325:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7e3ee27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060613888:12345-0@lo:41: 00000004:00000024:3.0:1788839519.617355:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788839519.617391:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7e3ee27 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060613888:12345-0@lo:41: Request processed in 68us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.617792:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839519.617803:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001a1cf54b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060614400:0@lo:400: 00000100:00100000:2.0:1788839519.617855:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839519.617919:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614400 00000100:00100000:2.0:1788839519.617924:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614400 00000100:00100000:2.0:1788839519.617957:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839519.617964:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f092204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060614400:12345-0@lo:400: 00000100:00100000:2.0:1788839519.618002:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f092204 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060614400:12345-0@lo:400: Request processed in 39us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.618008:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788839519.618226:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001a1cf54b x1875734060614400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839519.618239:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001a1cf54b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060614400:0@lo:400: 00000100:00100000:1.0:1788839519.618335:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000618d7068 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060613888:0@lo:41: 00000100:00100000:3.0:1788839519.619211:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839519.619256:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614016 00000100:00100000:3.0:1788839519.619261:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614016 00000100:00100000:3.0:1788839519.619294:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788839519.619299:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013a381bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060614016:12345-0@lo:501: 00000100:00100000:3.0:1788839519.619454:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013a381bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060614016:12345-0@lo:501: Request processed in 154us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839519.619461:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839519.620616:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007663b3c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060614144:0@lo:400: 00000100:00100000:1.0:1788839519.620669:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839519.620714:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839519.620720:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097436a3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060614272:0@lo:400: 00000100:00100000:1.0:1788839519.620749:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839519.621494:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614144 00000100:00100000:2.0:1788839519.621505:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614144 00000100:00100000:2.0:1788839519.621548:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788839519.621555:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000618d7068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060614144:12345-0@lo:400: 00000100:00100000:2.0:1788839519.621621:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000618d7068 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060614144:12345-0@lo:400: Request processed in 67us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.621628:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839519.621759:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614272 00000100:00100000:3.0:1788839519.621766:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614272 00000100:00100000:3.0:1788839519.621812:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839519.621817:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002612d033 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060614272:12345-0@lo:400: 00000100:00100000:3.0:1788839519.623750:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002612d033 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060614272:12345-0@lo:400: Request processed in 1927us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839519.623765:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839519.623972:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097436a3f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060614272:0@lo:400: 00010000:00080000:1.0:1788839519.623989:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007663b3c8 x1875734060614144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839519.624000:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007663b3c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060614144:0@lo:400: 00000100:00100000:3.0:1788839519.627787:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060614016:0@lo:501: 00000100:00100000:3.0:1788839519.627879:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060614528:0@lo:503: 00000100:00100000:3.0:1788839519.627988:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.628037:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b854bfff going to sleep for 11 seconds 00000100:00100000:0.0:1788839519.631757:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614528 00000100:00100000:0.0:1788839519.631795:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614528 00000100:00100000:0.0:1788839519.631876:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839519.631884:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1e07576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060614528:12345-0@lo:503: 00000100:00100000:0.0:1788839519.632325:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1e07576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060614528:12345-0@lo:503: Request processed in 441us (4337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.632334:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788839519.632554:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f7abed9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060614528:0@lo:503: 00000100:00100000:3.0:1788839519.643646:0:8124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005138e6fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8124:1875734060614656:0@lo:502: 00000100:00100000:3.0:1788839519.643752:0:8124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.643843:0:8124:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bbf34031 going to sleep for 11 seconds 00000100:00100000:0.0:1788839519.644258:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614656 00000100:00100000:0.0:1788839519.644266:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614656 00000100:00100000:0.0:1788839519.644320:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839519.644329:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000faf80843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:8124:x1875734060614656:12345-0@lo:502: 00000100:00100000:0.0:1788839519.644471:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000faf80843 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:8124:x1875734060614656:12345-0@lo:502: Request processed in 143us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.644488:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788839519.644705:0:8124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005138e6fe pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8124:1875734060614656:0@lo:502: 00000020:01000000:3.0:1788839519.644735:0:8124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839519.644745:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839519.644748:0:8124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788839519.644755:0:8124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab74434b000 00000020:00000080:3.0:1788839519.644758:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788839519.644855:0:8124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8124:1875734060614784:0@lo:502: 00000100:00100000:3.0:1788839519.644905:0:8124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.644939:0:8124:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839519.645343:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614784 00000100:00100000:0.0:1788839519.645349:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614784 00000100:00100000:0.0:1788839519.645387:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839519.645401:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:8124:x1875734060614784:12345-0@lo:502: 00000100:00100000:0.0:1788839519.645502:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:8124:x1875734060614784:12345-0@lo:502: Request processed in 108us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839519.645510:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788839519.645682:0:8124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8124:1875734060614784:0@lo:502: 00000020:01000000:2.0:1788839519.645704:0:8124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839519.645710:0:8124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839519.645712:0:8124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788839519.645716:0:8124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788839519.646134:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788839519.646154:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839519.646165:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839519.646190:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839519.646201:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839519.646204:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab745341000 from 1 10000000:01000000:0.0:1788839519.646207:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839519.646233:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839519.646241:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839519.646249:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839519.646265:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060614912:0@lo:101: 00000100:00100000:0.0:1788839519.646299:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839519.646333:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742b570c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839519.646374:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060614912 00000100:00100000:2.0:1788839519.646384:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060614912 00000100:00100000:2.0:1788839519.646421:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788839519.646428:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060614912:12345-0@lo:101: 00010000:00010000:2.0:1788839519.646438:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839519.646450:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572866 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839519.646471:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572866 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839519.646492:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572866 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839519.646500:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cba00, rc 0) 00000100:00100000:2.0:1788839519.646544:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060614912:12345-0@lo:101: Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.646549:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788839519.646711:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060614912:0@lo:101: 00010000:00010000:3.0:1788839519.646725:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839519.646733:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839519.646817:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060615040:0@lo:501: 00000100:00100000:3.0:1788839519.646984:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.647008:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839519.647951:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615040 00000100:00100000:2.0:1788839519.647961:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615040 00000100:00100000:2.0:1788839519.648009:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788839519.648017:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060615040:12345-0@lo:501: 00000100:00100000:2.0:1788839519.648281:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060615040:12345-0@lo:501: Request processed in 265us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.648288:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788839519.648691:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060615040:0@lo:501: 00000100:00100000:3.0:1788839519.648732:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060615168:0@lo:503: 00000100:00100000:3.0:1788839519.650437:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.650715:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839519.650754:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615168 00000100:00100000:2.0:1788839519.650762:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615168 00000100:00100000:2.0:1788839519.650975:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788839519.650988:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060615168:12345-0@lo:503: 00000100:00100000:2.0:1788839519.653707:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060615168:12345-0@lo:503: Request processed in 2714us (3677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.653727:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788839519.654147:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060615168:0@lo:503: 00000100:00100000:3.0:1788839519.660709:0:8125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8125:1875734060615296:0@lo:502: 00000100:00100000:3.0:1788839519.661410:0:8125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839519.661466:0:8125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839519.662695:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615296 00000100:00100000:2.0:1788839519.662707:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615296 00000100:00100000:2.0:1788839519.662795:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788839519.662805:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:8125:x1875734060615296:12345-0@lo:502: 00000100:00100000:2.0:1788839519.662996:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:8125:x1875734060615296:12345-0@lo:502: Request processed in 191us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.663004:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788839519.663255:0:8125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8125:1875734060615296:0@lo:502: 00000020:01000000:1.0:1788839519.663290:0:8125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839519.663300:0:8125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839519.663302:0:8125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839519.663310:0:8125:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab745341000 00000020:00000080:1.0:1788839519.663312:0:8125:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788839519.663348:0:8125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8125:1875734060615424:0@lo:502: 00000100:00100000:1.0:1788839519.663396:0:8125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839519.663419:0:8125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7506a79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839519.663469:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615424 00000100:00100000:2.0:1788839519.663473:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615424 00000100:00100000:2.0:1788839519.663489:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839519.663494:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:8125:x1875734060615424:12345-0@lo:502: 00000100:00100000:2.0:1788839519.663564:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:8125:x1875734060615424:12345-0@lo:502: Request processed in 68us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839519.663570:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839519.664978:0:8125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8125:1875734060615424:0@lo:502: 00000020:01000000:1.0:1788839519.665021:0:8125:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839519.665040:0:8125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839519.665042:0:8125:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788839519.665046:0:8125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788839519.665322:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788839519.665345:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839519.665358:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839519.665371:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839520.067265:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839521.093245:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839522.115156:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839522.690995:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060615552:0@lo:41: 00000100:00100000:1.0:1788839522.691071:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839522.691152:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615552 00000100:00100000:1.0:1788839522.691159:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615552 00000100:00100000:1.0:1788839522.691214:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839522.691223:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060615552:12345-0@lo:41: 00000004:00000024:1.0:1788839522.691274:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788839522.691318:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060615552:12345-0@lo:41: Request processed in 96us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839522.691325:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839522.691388:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060615552:0@lo:41: 00010000:00010000:0.0:1788839523.138867:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839524.162032:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839524.735557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060615680:0@lo:41: 00000100:00100000:2.0:1788839524.735636:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839524.735728:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615680 00000100:00100000:2.0:1788839524.735737:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615680 00000100:00100000:3.0:1788839524.737487:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060615936:0@lo:400: 00000100:00100000:3.0:1788839524.737548:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839524.737582:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839524.737588:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060616064:0@lo:400: 00000100:00100000:3.0:1788839524.737610:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839524.737633:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615936 00000100:00100000:3.0:1788839524.737638:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615936 00000100:00100000:3.0:1788839524.737682:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839524.737690:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060615936:12345-0@lo:400: 00000100:00100000:3.0:1788839524.737734:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060615936:12345-0@lo:400: Request processed in 46us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839524.737740:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788839524.737795:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777c37800 x1875734060615936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839524.737808:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060615936:0@lo:400: 00000100:00100000:3.0:1788839524.737828:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060616192:0@lo:400: 00000100:00100000:3.0:1788839524.737850:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839524.737884:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839524.737889:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060615808:0@lo:400: 00000100:00100000:3.0:1788839524.737916:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839524.737942:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616192 00000100:00100000:3.0:1788839524.737945:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616192 00000100:00100000:3.0:1788839524.737971:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839524.737977:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060616192:12345-0@lo:400: 00000100:00100000:3.0:1788839524.738080:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060616192:12345-0@lo:400: Request processed in 102us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839524.738095:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839524.738114:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060615808 00000100:00100000:3.0:1788839524.738117:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060615808 00000100:00100000:3.0:1788839524.738143:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839524.738149:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+18:3616:x1875734060615808:12345-0@lo:400: 00000100:00100000:3.0:1788839524.738176:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+18:3616:x1875734060615808:12345-0@lo:400: Request processed in 28us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839524.738182:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839524.738216:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060615808:0@lo:400: 00010000:00080000:3.0:1788839524.738227:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777c34e00 x1875734060616192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839524.738236:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060616192:0@lo:400: 00000100:00100000:2.0:1788839524.739946:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616064 00000100:00100000:2.0:1788839524.739959:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616064 00000100:00100000:2.0:1788839524.740010:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839524.740021:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060615680:12345-0@lo:41: 00000004:00000024:2.0:1788839524.740057:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788839524.740133:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060615680:12345-0@lo:41: Request processed in 115us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839524.740140:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839524.740167:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839524.740173:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060616064:12345-0@lo:400: 00000100:00100000:2.0:1788839524.740209:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060616064:12345-0@lo:400: Request processed in 36us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839524.740215:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839524.741177:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060615680:0@lo:41: 00000100:00100000:2.0:1788839524.741289:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060616064:0@lo:400: 00000020:01000004:0.0:1788839524.996061:0:8396:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788839524.996065:0:8396:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788839524.996066:0:8396:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788839524.996223:0:8396:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab777b41000 00000020:01000004:0.0:1788839524.996241:0:8396:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788839524.996255:0:8396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788839524.996274:0:8396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ab77e4f8000) 00000020:00000080:0.0:1788839524.996291:0:8396:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839525.044299:0:8396:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788839525.045024:0:8396:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788839525.063816:0:8396:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788839525.064216:0:8396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788839525.064230:0:8396:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839525.064243:0:8396:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad5b343a2657287b 00000020:01000004:2.0:1788839525.064250:0:8396:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788839525.064275:0:8396:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788839525.064279:0:8396:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788839525.064286:0:8396:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788839525.064291:0:8396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788839525.064319:0:8396:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ab777fb3370) 00000020:00000080:2.0:1788839525.064331:0:8396:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788839525.066212:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839525.066464:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839525.066471:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788839525.071340:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788839525.071354:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788839525.072820:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788839525.072831:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788839525.074716:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839525.074984:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788839525.074991:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788839525.076952:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788839525.076964:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788839525.100906:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839525.101228:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788839525.101235:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788839525.103206:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788839525.103218:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788839525.107183:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788839525.107912:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788839525.111842:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839525.113152:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788839525.113161:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788839525.114818:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788839525.114829:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788839525.171731:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839525.172029:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788839525.172037:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788839525.175380:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788839525.175396:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788839525.177844:0:8396:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788839525.177884:0:8396:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788839525.177892:0:8396:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:0.0:1788839525.183903:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788839525.212355:0:8396:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788839525.212395:0:8396:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788839525.212400:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788839525.212402:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839525.212403:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839525.212405:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839525.212406:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839525.212407:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839525.212409:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839525.212411:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839525.212417:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839525.212419:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839525.212420:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839525.212424:0:8396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788839525.212426:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839525.212427:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788839525.212428:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839525.212429:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839525.212430:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839525.212431:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839525.212432:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839525.212433:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839525.212434:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839525.212435:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839525.212436:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839525.213131:0:8396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788839525.213153:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060616320:0@lo:253: 00000100:00100000:2.0:1788839525.213222:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.213279:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745c04cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839525.213629:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616320 00000100:00100000:0.0:1788839525.213637:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616320 00000100:00100000:0.0:1788839525.213684:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788839525.213692:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:8396:x1875734060616320:12345-0@lo:253: 20000000:01000000:0.0:1788839525.213721:0:6479:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788839525.213725:0:6479:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788839525.213730:0:6479:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788839525.213733:0:6479:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788839525.213984:0:6479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839525.214122:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788839525.214138:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788839525.214152:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788839525.214156:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788839525.214166:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788839525.214177:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788839525.214249:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788839525.214262:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1788839525.214264:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788839525.214281:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788839525.214286:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788839525.214297:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788839525.214301:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1788839525.214311:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788839525.214316:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788839525.214326:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788839525.214338:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788839525.214402:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788839525.214412:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1788839525.214414:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788839525.214427:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788839525.214432:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788839525.214456:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788839525.214462:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1788839525.214475:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788839525.214480:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788839525.214509:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788839525.214523:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788839525.214918:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788839525.214929:0:6479:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1788839525.214931:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1788839525.214944:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788839525.214949:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788839525.214961:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788839525.214966:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1788839525.214978:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788839525.214983:0:6479:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788839525.214995:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788839525.215008:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788839525.215028:0:6479:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788839525.215031:0:6479:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788839525.215034:0:6479:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788839525.215088:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788839525.215091:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788839525.218406:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788839525.218467:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788839525.218486:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788839525.218725:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788839525.218764:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788839525.218812:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788839525.218825:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788839525.218828:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788839525.219320:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788839525.219338:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788839525.219366:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788839525.219520:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788839525.219535:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788839525.219546:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:0.0:1788839525.219552:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788839525.219554:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788839525.220568:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788839525.220608:0:8417:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788839525.220624:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788839525.220811:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788839525.220833:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788839525.220848:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788839525.220860:0:6479:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788839525.220862:0:6479:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788839525.221581:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788839525.221742:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788839525.221766:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788839525.221822:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:0.0:1788839525.221840:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788839525.221860:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222017:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657274e expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222026:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727c5 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222033:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727fd expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222052:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572819 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222059:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572843 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222066:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222107:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572843 expref: 18 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222126:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572843 expref: 18 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.222140:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616448:0@lo:104: 00000100:00100000:0.0:1788839525.222208:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839525.222265:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572819 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222272:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572819 expref: 18 pid: 6481 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.222280:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616576:0@lo:104: 00000100:00100000:0.0:1788839525.222300:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839525.222329:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265727fd expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222338:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265727fd expref: 18 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.222402:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616448 00000100:00100000:1.0:1788839525.222409:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616448 00000100:00100000:0.0:1788839525.222441:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616704:0@lo:104: 00000100:00100000:1.0:1788839525.222453:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616576 00000100:00100000:1.0:1788839525.222456:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616576 00000100:00100000:0.0:1788839525.222463:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839525.222466:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616704 00000100:00100000:1.0:1788839525.222469:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616704 00010000:00010000:0.0:1788839525.222479:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265727c5 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.222481:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788839525.222487:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265727c5 expref: 18 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.222488:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6479:x1875734060616448:12345-0@lo:104: 00000100:00100000:0.0:1788839525.222495:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616832:0@lo:104: 00010000:00010000:1.0:1788839525.222507:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.222512:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839525.222525:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657274e expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.222533:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657274e expref: 18 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.222540:0:6479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616960:0@lo:104: 00010000:00010000:1.0:1788839525.222557:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839525.222557:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839525.222563:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6479:x1875734060616448:12345-0@lo:104: Request processed in 75us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839525.222567:0:6479:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.222570:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839525.222583:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616832 00000100:00100000:0.0:1788839525.222584:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616448:0@lo:104: 00000100:00100000:1.0:1788839525.222586:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616832 00000100:00100000:1.0:1788839525.222595:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060616960 00000100:00100000:1.0:1788839525.222598:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060616960 00000100:00100000:1.0:1788839525.222608:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839525.222613:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+6:6479:x1875734060616576:12345-0@lo:104: 00010000:00010000:1.0:1788839525.222621:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.222665:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788839525.222670:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+6:6479:x1875734060616576:12345-0@lo:104: Request processed in 58us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.222676:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839525.222679:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616576:0@lo:104: 00000100:00100000:1.0:1788839525.222687:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839525.222692:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6479:x1875734060616704:12345-0@lo:104: 00010000:00010000:1.0:1788839525.222699:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222715:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839525.222723:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.222728:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788839525.222731:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413caa00 already unused, calling callback (ffffffffc1387c20) 00000100:00100000:1.0:1788839525.222732:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:6479:x1875734060616704:12345-0@lo:104: Request processed in 40us (269us total) trans 0 rc 0/0 10000000:00010000:3.0:1788839525.222736:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222745:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.222745:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839525.222757:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839525.222761:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:6479:x1875734060616832:12345-0@lo:104: 10000000:00010000:3.0:1788839525.222762:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.222787:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.222788:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839525.222812:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788839525.222817:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:6479:x1875734060616832:12345-0@lo:104: Request processed in 56us (304us total) trans 0 rc 0/0 00010000:00010000:3.0:1788839525.222818:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.222823:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788839525.222825:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788839525.222834:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839525.222839:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:6479:x1875734060616960:12345-0@lo:104: 00010000:00010000:3.0:1788839525.222844:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.222845:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222851:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413caa00/0xad5b343a26572843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657284a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222865:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788839525.222866:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1788839525.222881:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.222882:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:6479:x1875734060616960:12345-0@lo:104: Request processed in 32us (313us total) trans 0 rc 0/0 00010000:00010000:3.0:1788839525.222888:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413ca600 already unused, calling callback (ffffffffc1387c20) 00000100:00100000:1.0:1788839525.222888:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 10000000:00010000:3.0:1788839525.222891:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222897:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839525.222903:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.222909:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839525.222929:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222935:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839525.222956:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222963:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572820 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222973:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788839525.222976:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222982:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839525.222985:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.222991:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839525.222997:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.223001:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839525.223013:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223019:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839525.223024:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223039:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553400/0xad5b343a265727fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572804 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223048:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839525.223051:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223055:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741465400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839525.223058:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223063:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839525.223068:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.223072:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839525.223085:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223089:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839525.223095:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223100:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741465400/0xad5b343a265727c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727cc expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223110:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839525.223117:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223123:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839525.223125:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223131:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839525.223136:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.223141:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839525.223153:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223158:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839525.223161:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223166:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741464400/0xad5b343a2657274e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572755 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223177:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839525.223179:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839525.223180:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839525.223198:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060617088:0@lo:103: 00000100:00100000:3.0:1788839525.223228:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.223253:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060617600:0@lo:103: 00000100:00100000:3.0:1788839525.223281:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.223298:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839525.223303:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060617472:0@lo:103: 00000100:00100000:3.0:1788839525.223320:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.223360:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060617344:0@lo:103: 00000100:00100000:3.0:1788839525.223395:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.223408:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839525.223412:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060617216:0@lo:103: 00000100:00100000:3.0:1788839525.223433:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.223450:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617088 00000100:00100000:3.0:1788839525.223455:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617088 00010000:00010000:3.0:1788839525.223474:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572843 expref: 19 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.223489:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617600 00000100:00100000:3.0:1788839525.223492:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617600 00010000:00010000:3.0:1788839525.223500:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657274e expref: 20 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.223509:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617472 00000100:00100000:3.0:1788839525.223511:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617472 00010000:00010000:3.0:1788839525.223520:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727c5 expref: 21 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.223528:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617344 00000100:00100000:3.0:1788839525.223530:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617344 00010000:00010000:3.0:1788839525.223539:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727fd expref: 22 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.223547:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617216 00000100:00100000:3.0:1788839525.223555:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617216 00010000:00010000:3.0:1788839525.223568:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572819 expref: 23 pid: 6481 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.223581:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839525.223587:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+23:3617:x1875734060617088:12345-0@lo:103: 00010000:00010000:3.0:1788839525.223598:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839525.223602:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572843 expref: 23 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223613:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572843 expref: 23 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223626:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078c00/0xad5b343a2657284a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572843 expref: 23 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.223629:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788839525.223637:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788839525.223638:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839525.223665:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+22:3617:x1875734060617088:12345-0@lo:103: Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.223670:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839525.223683:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839525.223688:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060617600:12345-0@lo:103: 00010000:00010000:3.0:1788839525.223695:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839525.223699:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657274e expref: 21 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223706:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657274e expref: 21 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223715:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839525.223738:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060617600:12345-0@lo:103: Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.223744:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839525.223755:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839525.223761:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+20:3617:x1875734060617472:12345-0@lo:103: 00000100:00100000:1.0:1788839525.223788:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839525.223795:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+20:3615:x1875734060617344:12345-0@lo:103: 00010000:00010000:3.0:1788839525.223796:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839525.223801:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727c5 expref: 20 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.223803:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839525.223807:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727fd expref: 20 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223809:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265727c5 expref: 20 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223818:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839525.223824:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265727fd expref: 20 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.223832:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839525.223838:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+20:3617:x1875734060617472:12345-0@lo:103: Request processed in 77us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.223843:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839525.223854:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788839525.223855:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+19:3615:x1875734060617344:12345-0@lo:103: Request processed in 61us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.223860:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839525.223863:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839525.223868:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+18:3615:x1875734060617216:12345-0@lo:103: 00010000:00010000:3.0:1788839525.223886:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839525.223890:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572819 expref: 18 pid: 6481 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223898:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572819 expref: 18 pid: 6481 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223907:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572819 expref: 18 pid: 6481 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223917:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223929:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223943:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223949:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223956:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223962:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223968:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839525.223971:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223979:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223987:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.223996:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839525.224019:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+17:3615:x1875734060617216:12345-0@lo:103: Request processed in 151us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.224026:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839525.224087:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060617216:0@lo:103: 00000100:00100000:3.0:1788839525.224105:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060617344:0@lo:103: 00000100:00100000:3.0:1788839525.224130:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060617472:0@lo:103: 00000100:00100000:3.0:1788839525.224137:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060617088:0@lo:103: 00000100:00100000:3.0:1788839525.224143:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060617600:0@lo:103: 00010000:00010000:0.0:1788839525.224477:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572804 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265727fd expref: 16 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.224489:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616704:0@lo:104: 00010000:00010000:0.0:1788839525.224500:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031000/0xad5b343a265727cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265727c5 expref: 15 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.224522:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616832:0@lo:104: 00010000:00010000:0.0:1788839525.224534:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740030000/0xad5b343a26572755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657274e expref: 14 pid: 6479 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.224543:0:6479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ef800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6479:1875734060616960:0@lo:104: 00010000:00010000:0.0:1788839525.224565:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.224574:0:6479:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.224580:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.224586:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031c00/0xad5b343a26572889 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839525.224596:0:6479:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788839525.224683:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839525.229907:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+13:8396:x1875734060616320:12345-0@lo:253: Request processed in 16206us (16675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839525.229923:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788839525.230113:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060616320:0@lo:253: 10000000:01000000:3.0:1788839525.230129:0:8396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788839525.230133:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839525.230134:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839525.230135:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839525.230136:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788839525.230138:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839525.230139:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839525.230140:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839525.230142:0:8396:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788839525.230143:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839525.230144:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839525.230165:0:8396:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab777b41000 from lustre-OST0000 10000000:01000000:3.0:1788839525.230198:0:8396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788839525.230201:0:8396:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788839525.230209:0:8396:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab7486e8000 local copy 10000000:01000000:3.0:1788839525.230213:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839525.230247:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.230257:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.230266:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.230298:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060617728:0@lo:101: 00000100:00100000:3.0:1788839525.230333:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.230409:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b619c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839525.230458:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617728 00000100:00100000:2.0:1788839525.230465:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617728 00000100:00100000:2.0:1788839525.230541:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788839525.230555:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+13:8396:x1875734060617728:12345-0@lo:101: 00010000:00010000:2.0:1788839525.230568:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839525.230581:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cbe00/0xad5b343a26572897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572890 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.230603:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cbe00/0xad5b343a26572897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572890 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.230615:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cbe00/0xad5b343a26572897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572890 expref: 14 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.230624:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cbe00, rc 0) 00000100:00100000:2.0:1788839525.230664:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060617728:12345-0@lo:101: Request processed in 110us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.230669:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788839525.230729:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060617728:0@lo:101: 00010000:00010000:0.0:1788839525.230742:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.230751:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.230960:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060617856:0@lo:501: 00000100:00100000:0.0:1788839525.230987:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.231021:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.231049:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617856 00000100:00100000:1.0:1788839525.231054:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617856 00000100:00100000:1.0:1788839525.231075:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788839525.231081:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060617856:12345-0@lo:501: 00000100:00100000:1.0:1788839525.231148:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060617856:12345-0@lo:501: Request processed in 67us (160us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839525.231154:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788839525.231246:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060617856:0@lo:501: 10000000:01000000:0.0:1788839525.231261:0:8396:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788839525.231278:0:8396:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788839525.231283:0:8396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.231290:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.231296:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.231317:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788839525.231339:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab777b41000 00010000:00010000:3.0:1788839525.231350:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839525.231356:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839525.231360:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788839525.231364:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078c00 already unused, calling callback (ffffffffc1387c20) 10000000:01000000:0.0:1788839525.231365:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788839525.231367:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:3.0:1788839525.231369:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839525.231371:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788839525.231374:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839525.231377:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839525.231384:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.231388:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.231390:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839525.231395:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.231413:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.231423:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060617984:0@lo:101: 00000100:00100000:0.0:1788839525.231448:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.231467:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839525.231535:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060617984 00000100:00100000:2.0:1788839525.231540:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060617984 00000100:00100000:2.0:1788839525.231568:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839525.231576:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060617984:12345-0@lo:101: 00010000:00010000:2.0:1788839525.231583:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839525.231593:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657289e expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.231608:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657289e expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.231617:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657289e expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.231624:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cbc00, rc 0) 00000100:00100000:2.0:1788839525.231666:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060617984:12345-0@lo:101: Request processed in 91us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.231672:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788839525.231803:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060617984:0@lo:101: 00010000:00010000:3.0:1788839525.231976:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.231984:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788839525.232035:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1788839525.232053:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.232060:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a26572897 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.232073:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839525.232080:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839525.232082:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839525.232236:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060618112:0@lo:103: 00000100:00100000:2.0:1788839525.232267:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839525.232361:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.232371:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839525.232436:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618240:0@lo:501: 00000100:00100000:0.0:1788839525.232470:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.232490:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839525.232593:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618240 00000100:00100000:3.0:1788839525.232599:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618240 00000100:00100000:3.0:1788839525.232633:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839525.232640:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618240:12345-0@lo:501: 00000100:00100000:3.0:1788839525.232751:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618240:12345-0@lo:501: Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.232758:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839525.232992:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618240:0@lo:501: 00000100:00100000:0.0:1788839525.233029:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618368:0@lo:503: 00000100:00100000:0.0:1788839525.233074:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.233102:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839525.233187:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618368 00000100:00100000:2.0:1788839525.233191:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618368 00000100:00100000:2.0:1788839525.233218:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788839525.233224:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618368:12345-0@lo:503: 00000100:00100000:2.0:1788839525.233301:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618368:12345-0@lo:503: Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.233307:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788839525.233534:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618368:0@lo:503: 00000040:00080000:0.0:1788839525.233949:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839525.234120:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618496:0@lo:502: 00000100:00100000:0.0:1788839525.234161:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.234220:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.234490:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618112 00000100:00100000:1.0:1788839525.234496:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618112 00000100:00100000:1.0:1788839525.234545:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839525.234553:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+15:3615:x1875734060618112:12345-0@lo:103: 00010000:00010000:1.0:1788839525.234565:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839525.234583:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cbe00/0xad5b343a26572897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572890 expref: 15 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.234598:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839525.234632:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+14:3615:x1875734060618112:12345-0@lo:103: Request processed in 81us (2364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.234638:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839525.234997:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060618112:0@lo:103: 00000100:00100000:2.0:1788839525.235158:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618496 00000100:00100000:2.0:1788839525.235163:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618496 00000100:00100000:2.0:1788839525.235227:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788839525.235235:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060618496:12345-0@lo:502: 00000100:00100000:2.0:1788839525.235339:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060618496:12345-0@lo:502: Request processed in 105us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.235346:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839525.235416:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618496:0@lo:502: 00000040:00080000:0.0:1788839525.235657:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788839525.235684:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788839525.235699:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788839525.235712:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788839525.235724:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788839525.235736:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788839525.235761:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618624:0@lo:502: 00000100:00100000:0.0:1788839525.235828:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.236219:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.236287:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618624 00000100:00100000:1.0:1788839525.236297:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618624 00000100:00100000:1.0:1788839525.236320:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788839525.236326:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060618624:12345-0@lo:502: 00000100:00100000:1.0:1788839525.236415:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060618624:12345-0@lo:502: Request processed in 88us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.236421:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788839525.236528:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618624:0@lo:502: 00000040:00080000:0.0:1788839525.236575:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788839525.236584:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788839525.237292:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839525.237300:0:8420:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788839525.237307:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839525.237309:0:8420:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788839525.237314:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839525.237328:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ab777fb19b8) 00000020:00000080:2.0:1788839525.237349:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788839525.237354:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788839525.237431:0:8420:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab777b41000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788839525.237500:0:8420:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788839525.237508:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad5b343a265728b3 00010000:00010000:3.0:1788839525.251563:0:8420:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:3.0:1788839525.252210:0:8420:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788839525.256683:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788839525.257246:0:8420:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788839525.264822:0:8420:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788839525.265188:0:8420:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788839525.274343:0:8420:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788839525.277991:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788839525.278008:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839525.278015:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839525.278026:0:8420:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788839525.278029:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839525.278034:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839525.278035:0:8420:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788839525.278038:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788839525.278040:0:8420:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788839525.278070:0:8420:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839525.278074:0:8420:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839525.278075:0:8420:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788839525.278078:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788839525.279247:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788839525.279284:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788839525.279311:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.279325:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.279334:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab777b41000 from 1 10000000:01000000:3.0:1788839525.279337:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839525.279377:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.279386:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.279410:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.279435:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618752:0@lo:101: 00000100:00100000:3.0:1788839525.279617:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.279667:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.279719:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618752 00000100:00100000:1.0:1788839525.279726:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618752 00000100:00100000:1.0:1788839525.279790:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788839525.279799:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:8396:x1875734060618752:12345-0@lo:101: 00010000:00010000:1.0:1788839525.279813:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839525.279826:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265728ba expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.279847:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265728ba expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.279858:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265728ba expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.279882:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553a00, rc 0) 00000100:00100000:1.0:1788839525.279923:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618752:12345-0@lo:101: Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.279929:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839525.280339:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618752:0@lo:101: 00010000:00010000:3.0:1788839525.280355:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.280364:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.280557:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618880:0@lo:501: 00000100:00100000:3.0:1788839525.280587:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.280621:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467b40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.280717:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060618880 00000100:00100000:1.0:1788839525.280722:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060618880 00000100:00100000:1.0:1788839525.280811:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788839525.280819:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618880:12345-0@lo:501: 00000100:00100000:1.0:1788839525.280924:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060618880:12345-0@lo:501: Request processed in 106us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.280931:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839525.281006:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060618880:0@lo:501: 00000100:00100000:3.0:1788839525.281052:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619008:0@lo:503: 00000100:00100000:3.0:1788839525.281088:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.283506:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467b40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839525.288258:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619008 00000100:00100000:2.0:1788839525.288272:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619008 00000100:00100000:2.0:1788839525.288328:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788839525.288338:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619008:12345-0@lo:503: 00000100:00100000:2.0:1788839525.289925:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619008:12345-0@lo:503: Request processed in 1578us (8825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.289939:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788839525.290580:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619008:0@lo:503: 00000040:00080000:0.0:1788839525.290888:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839525.290994:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619136:0@lo:502: 00000100:00100000:0.0:1788839525.293056:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.293111:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839525.293132:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619136 00000100:00100000:3.0:1788839525.293142:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619136 00000100:00100000:3.0:1788839525.293201:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788839525.293211:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619136:12345-0@lo:502: 00000100:00100000:3.0:1788839525.293343:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619136:12345-0@lo:502: Request processed in 134us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.293358:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788839525.293454:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619136:0@lo:502: 00000040:00080000:0.0:1788839525.293679:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788839525.293712:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788839525.293743:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619264:0@lo:502: 00000100:00100000:0.0:1788839525.293855:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.293923:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839525.295439:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619264 00000100:00100000:3.0:1788839525.295449:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619264 00000100:00100000:3.0:1788839525.295504:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839525.295514:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619264:12345-0@lo:502: 00000100:00100000:3.0:1788839525.295641:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619264:12345-0@lo:502: Request processed in 129us (1786us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.295649:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788839525.295766:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619264:0@lo:502: 00000040:00080000:2.0:1788839525.295883:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788839525.295895:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788839525.296697:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839525.296707:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839525.296710:0:8424:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839525.296717:0:8424:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab777b41000 00000020:00000080:1.0:1788839525.296720:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839525.296731:0:8424:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839525.296734:0:8424:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839525.296735:0:8424:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788839525.296738:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788839525.296940:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788839525.296967:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839525.296987:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.296998:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839525.297053:0:8396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788839525.297056:0:8396:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab777b41000 10000000:01000000:2.0:1788839525.297059:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab777b41000 10000000:01000000:2.0:1788839525.297063:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839525.297068:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab777b41000 from 1 10000000:01000000:2.0:1788839525.297071:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839525.297099:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.297108:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.297125:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839525.297146:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619392:0@lo:101: 00000100:00100000:2.0:1788839525.297206:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.297247:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839525.297359:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619392 00000100:00100000:0.0:1788839525.297371:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619392 00000100:00100000:0.0:1788839525.297414:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788839525.297422:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:8396:x1875734060619392:12345-0@lo:101: 00010000:00010000:0.0:1788839525.297433:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839525.297445:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265728c8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.297467:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265728c8 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.297478:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265728c8 expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839525.297486:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740030000, rc 0) 00000100:00100000:0.0:1788839525.297528:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619392:12345-0@lo:101: Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839525.297534:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788839525.297701:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619392:0@lo:101: 00010000:00010000:2.0:1788839525.297714:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.297722:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839525.297826:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619520:0@lo:501: 00000100:00100000:2.0:1788839525.297849:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.297861:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839525.297937:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619520 00000100:00100000:3.0:1788839525.297941:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619520 00000100:00100000:3.0:1788839525.297969:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788839525.297976:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619520:12345-0@lo:501: 00000100:00100000:3.0:1788839525.298069:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619520:12345-0@lo:501: Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.298076:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788839525.298204:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619520:0@lo:501: 00000100:00100000:2.0:1788839525.298226:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619648:0@lo:503: 00000100:00100000:2.0:1788839525.298260:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.298284:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839525.298373:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619648 00000100:00100000:3.0:1788839525.298377:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619648 00000100:00100000:3.0:1788839525.298403:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788839525.298409:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619648:12345-0@lo:503: 00000100:00100000:3.0:1788839525.298477:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619648:12345-0@lo:503: Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.298484:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788839525.298635:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619648:0@lo:503: 00000040:00080000:2.0:1788839525.298865:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839525.298942:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619776:0@lo:502: 00000100:00100000:2.0:1788839525.298969:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.298984:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839525.299055:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619776 00000100:00100000:0.0:1788839525.299059:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619776 00000100:00100000:0.0:1788839525.299078:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788839525.299084:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619776:12345-0@lo:502: 00000100:00100000:0.0:1788839525.299152:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619776:12345-0@lo:502: Request processed in 67us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839525.299158:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788839525.299337:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619776:0@lo:502: 00000040:00080000:2.0:1788839525.299492:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788839525.299511:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788839525.299522:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788839525.299532:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788839525.299542:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788839525.299552:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788839525.299562:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788839525.299572:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788839525.299583:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788839525.299593:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788839525.299603:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788839525.299613:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788839525.299623:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788839525.299633:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788839525.299643:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788839525.299653:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788839525.299673:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788839525.299684:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788839525.299694:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788839525.299705:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788839525.299715:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788839525.299725:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788839525.299735:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788839525.299745:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788839525.299756:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788839525.299766:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788839525.299969:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788839525.299979:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788839525.299989:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788839525.300000:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788839525.300010:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788839525.300087:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788839525.300106:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788839525.300117:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788839525.300127:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788839525.300137:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788839525.300147:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1788839525.300169:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619904:0@lo:502: 00000100:00100000:2.0:1788839525.300264:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.300319:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839525.300419:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060619904 00000100:00100000:0.0:1788839525.300424:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060619904 00000100:00100000:0.0:1788839525.300486:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788839525.300492:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619904:12345-0@lo:502: 00000100:00100000:0.0:1788839525.300570:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060619904:12345-0@lo:502: Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839525.300581:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788839525.300639:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060619904:0@lo:502: 00000040:00080000:2.0:1788839525.300675:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788839525.300681:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788839525.303000:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788839525.303028:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab777fb4d28) 00000020:00000080:2.0:1788839525.303054:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788839525.303152:0:8425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab777b41000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788839525.303156:0:8425:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab777b41000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788839525.303158:0:8425:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab777b41000 3 00010000:00080000:2.0:1788839525.303201:0:8425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab77e444000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839525.305417:0:8425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:2.0:1788839525.305623:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788839525.305670:0:8425:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839525.305685:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xad5b343a265728dd 00000100:00080000:2.0:1788839525.305696:0:8425:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839525.305702:0:8425:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab77e444000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839525.305751:0:8425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7443d8e00 x1875734060620032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839525.305800:0:8425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788839525.305947:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060620032:0@lo:38: 00000100:00100000:3.0:1788839525.306021:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.306091:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620032 00000100:00100000:3.0:1788839525.306097:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620032 00000100:00100000:3.0:1788839525.306134:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839525.306153:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060620032:12345-0@lo:38: 00010000:00080000:3.0:1788839525.306178:0:7438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1788839525.306208:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad5b343a265728e4 00000004:00100000:3.0:1788839525.306223:0:7438:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788839525.306425:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839525.306435:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060620160:0@lo:400: 00000100:00100000:1.0:1788839525.306467:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839525.306498:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620160 00000100:00100000:1.0:1788839525.306503:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620160 00000100:00100000:1.0:1788839525.306536:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839525.306543:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060620160:12345-0@lo:400: 00000100:00100000:1.0:1788839525.306587:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060620160:12345-0@lo:400: Request processed in 45us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.306600:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788839525.306641:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443daa00 x1875734060620160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839525.306654:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060620160:0@lo:400: 00000100:00080000:3.0:1788839525.307027:0:7438:0:(import.c:65:import_set_state_nolock()) ffff8ab646524000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839525.307076:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875734060620032:12345-0@lo:38: Request processed in 933us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.307083:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788839525.307120:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443d8e00 x1875734060620032/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839525.307128:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839525.307134:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788839525.307142:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788839525.307146:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839525.307148:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839525.307155:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060620032:0@lo:38: 00000100:00100000:0.0:1788839525.312113:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839525.316241:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060620416:0@lo:400: 00000100:00100000:0.0:1788839525.316318:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839525.316360:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060620288:0@lo:400: 00000100:00100000:0.0:1788839525.316386:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839525.316457:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620416 00000100:00100000:1.0:1788839525.316465:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620416 00000100:00100000:1.0:1788839525.316517:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839525.316526:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060620416:12345-0@lo:400: 00000100:00100000:1.0:1788839525.316582:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060620416:12345-0@lo:400: Request processed in 57us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.316590:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788839525.316629:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7443d9180 x1875734060620416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839541 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839525.316643:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060620416:0@lo:400: 00000100:00100000:2.0:1788839525.317111:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620288 00000100:00100000:2.0:1788839525.317130:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620288 00000100:00100000:2.0:1788839525.317163:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839525.317170:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060620288:12345-0@lo:400: 00000100:00100000:2.0:1788839525.317220:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060620288:12345-0@lo:400: Request processed in 51us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.317227:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839525.317294:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060620544:0@lo:400: 00000100:00100000:2.0:1788839525.317321:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.317350:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620544 00000100:00100000:2.0:1788839525.317354:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620544 00000100:00100000:2.0:1788839525.317373:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839525.317379:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060620544:12345-0@lo:400: 00000100:00100000:2.0:1788839525.317410:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060620544:12345-0@lo:400: Request processed in 30us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.317416:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839525.317444:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060620544:0@lo:400: 00000100:00100000:1.0:1788839525.317580:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060620288:0@lo:400: 00000020:01000004:3.0:1788839525.320686:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788839525.320728:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ab646694d28) 00000020:00000080:3.0:1788839525.320754:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788839525.320906:0:8425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab777b41000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788839525.320911:0:8425:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab777b41000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788839525.320913:0:8425:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab777b41000 3 00010000:00080000:3.0:1788839525.320944:0:8425:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab646525800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839525.322560:0:8425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788839525.322789:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788839525.322831:0:8425:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839525.322851:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xad5b343a265728f2 00000100:00080000:3.0:1788839525.322861:0:8425:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839525.322866:0:8425:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ab646525800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839525.322910:0:8425:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab641aec700 x1875734060620672/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839525.322949:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060620672:0@lo:38: 00000100:00100000:3.0:1788839525.323038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.323101:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620672 00000100:00100000:3.0:1788839525.323108:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620672 00000100:00100000:3.0:1788839525.323138:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839525.323145:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060620672:12345-0@lo:38: 00010000:00080000:3.0:1788839525.323168:0:7438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:3.0:1788839525.323199:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xad5b343a265728f9 00000004:00100000:3.0:1788839525.323215:0:7438:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839525.323244:0:7438:0:(import.c:65:import_set_state_nolock()) ffff8ab646521800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839525.325651:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875734060620672:12345-0@lo:38: Request processed in 2495us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839525.325665:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788839525.325703:0:8425:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788839525.326125:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788839525.326193:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788839525.326224:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839525.326241:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839525.326253:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788839525.326303:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788839525.326309:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839525.326310:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839525.326311:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839525.326312:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839525.326314:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839525.326315:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839525.326316:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839525.326317:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839525.326319:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839525.326320:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839525.326324:0:8396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788839525.326326:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839525.326328:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839525.326329:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839525.326330:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839525.326330:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839525.326332:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839525.326333:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839525.326333:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788839525.326334:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788839525.326335:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839525.326336:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839525.326358:0:8396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788839525.326373:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060620800:0@lo:253: 00000100:00100000:1.0:1788839525.326433:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839525.326470:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419e7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788839525.326495:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620800 00000100:00100000:1.0:1788839525.326501:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620800 00000100:00100000:1.0:1788839525.326545:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788839525.326553:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060620800:12345-0@lo:253: 20000000:01000000:1.0:1788839525.326578:0:6480:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788839525.326592:0:6480:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788839525.327928:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab641aec700 x1875734060620672/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839525.327941:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839525.327950:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788839525.328134:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788839525.328139:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788839525.328143:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646525800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839525.328150:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060620672:0@lo:38: 20000000:01000000:1.0:1788839525.340356:0:6480:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788839525.340434:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788839525.340846:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788839525.340859:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788839525.340889:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.340907:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265727ef expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.340915:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657280b expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.340937:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.341155:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657280b expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.341172:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657280b expref: 16 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.341188:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060620928:0@lo:104: 00000100:00100000:3.0:1788839525.341264:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.341313:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788839525.341320:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265727ef expref: 16 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.341328:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265727ef expref: 16 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839525.341331:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060620928 00000100:00100000:3.0:1788839525.341336:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060621056:0@lo:104: 00000100:00100000:2.0:1788839525.341338:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060620928 00000100:00100000:3.0:1788839525.341355:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839525.341371:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839525.341372:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621056 00000100:00100000:2.0:1788839525.341375:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621056 00000100:00100000:2.0:1788839525.341389:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839525.341397:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060620928:12345-0@lo:104: 00010000:00010000:2.0:1788839525.341411:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839525.341461:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:8396:x1875734060620800:12345-0@lo:253: Request processed in 14908us (15026us total) trans 0 rc 0/0 00010000:00010000:2.0:1788839525.341471:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839525.341476:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060620928:12345-0@lo:104: Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839525.341478:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788839525.341486:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839525.341520:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839525.341527:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6503:x1875734060621056:12345-0@lo:104: 00010000:00010000:2.0:1788839525.341534:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341574:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839525.341579:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6503:x1875734060621056:12345-0@lo:104: Request processed in 54us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.341585:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788839525.341599:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1788839525.341601:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060620928:0@lo:104: 00010000:00010000:2.0:1788839525.341604:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839525.341609:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060621056:0@lo:104: 00010000:00010000:2.0:1788839525.341612:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cae00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839525.341616:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341624:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839525.341626:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839525.341632:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839525.341638:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788839525.341653:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:8396:1875734060620800:0@lo:253: 00010000:00010000:2.0:1788839525.341660:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839525.341662:0:8396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:2.0:1788839525.341666:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:3.0:1788839525.341669:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839525.341671:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839525.341672:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839525.341673:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839525.341674:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839525.341675:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839525.341676:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839525.341678:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788839525.341680:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788839525.341681:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839525.341682:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:2.0:1788839525.341685:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341691:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a2657280b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572812 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:3.0:1788839525.341692:0:8396:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788839525.341703:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839525.341706:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341711:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413ca800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839525.341713:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341719:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839525.341724:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839525.341729:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839525.341741:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341747:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839525.341761:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341766:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a265727ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265727f6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.341798:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839525.341805:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839525.341806:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839525.341818:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060621184:0@lo:103: 00000100:00100000:2.0:1788839525.341849:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839525.341917:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839525.341960:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060621312:0@lo:103: 00000100:00100000:2.0:1788839525.341985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839525.342035:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621184 00000100:00100000:2.0:1788839525.342040:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621184 00010000:00010000:2.0:1788839525.342056:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657280b expref: 16 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839525.342075:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621312 00000100:00100000:2.0:1788839525.342077:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621312 00010000:00010000:2.0:1788839525.342086:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727ef expref: 17 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839525.342100:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839525.342106:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+17:3615:x1875734060621184:12345-0@lo:103: 00010000:00010000:2.0:1788839525.342115:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839525.342120:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657280b expref: 17 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342128:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657280b expref: 17 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342140:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031e00/0xad5b343a26572812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657280b expref: 17 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342150:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839525.342176:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+16:3615:x1875734060621184:12345-0@lo:103: Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.342187:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839525.342200:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839525.342205:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+15:3616:x1875734060621312:12345-0@lo:103: 00010000:00010000:2.0:1788839525.342213:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839525.342218:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265727ef expref: 15 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342226:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265727ef expref: 15 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342234:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cb400/0xad5b343a265727f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265727ef expref: 15 pid: 6480 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342244:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342251:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788839525.342262:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015642370s 00010000:00010000:2.0:1788839525.342266:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342271:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342277:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342282:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342292:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839525.342297:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342303:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342316:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342324:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839525.342350:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+14:3616:x1875734060621312:12345-0@lo:103: Request processed in 145us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839525.342356:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839525.342386:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060621184:0@lo:103: 00000100:00100000:2.0:1788839525.342402:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060621312:0@lo:103: 00010000:00010000:2.0:1788839525.342416:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342423:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839525.342428:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078000/0xad5b343a26572900 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788839525.353113:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788839525.353277:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788839525.353477:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788839525.353621:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788839525.353822:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788839525.354047:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788839525.359562:0:8396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788839525.366802:0:8396:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788839525.366811:0:8396:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788839525.366848:0:8396:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788839525.366997:0:8396:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788839525.367016:0:8396:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788839525.367111:0:8396:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788839525.368462:0:8396:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839525.368641:0:8396:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788839526.208907:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788839526.262048:0:8481:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839526.262285:0:8481:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788839527.167147:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788839527.167156:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab74434b000 from 30 10000000:01000000:1.0:1788839527.167163:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839527.167205:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.167217:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.167228:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839527.167254:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060621440:0@lo:101: 00000100:00100000:1.0:1788839527.167316:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.167381:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777bc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.167387:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621440 00000100:00100000:3.0:1788839527.167395:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621440 00000100:00100000:3.0:1788839527.167468:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788839527.167477:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+14:6483:x1875734060621440:12345-0@lo:101: 00010000:00010000:3.0:1788839527.167492:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839527.167505:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572907 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.167539:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572907 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.167682:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572907 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.167700:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079200, rc 0) 00000100:00100000:3.0:1788839527.167755:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060621440:12345-0@lo:101: Request processed in 279us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.167762:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788839527.168050:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060621440:0@lo:101: 00010000:00010000:2.0:1788839527.168065:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.168081:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.168143:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060621568:0@lo:501: 00000100:00100000:2.0:1788839527.168171:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.168191:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745c04cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.168238:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621568 00000100:00100000:1.0:1788839527.168243:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621568 00000100:00100000:1.0:1788839527.168273:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788839527.168280:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060621568:12345-0@lo:501: 00000100:00100000:1.0:1788839527.168403:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060621568:12345-0@lo:501: Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.168415:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788839527.168600:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060621568:0@lo:501: 00000100:00100000:2.0:1788839527.168628:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060621696:0@lo:503: 00000100:00100000:2.0:1788839527.168667:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.168689:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745c04cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.168735:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621696 00000100:00100000:1.0:1788839527.168739:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621696 00000100:00100000:1.0:1788839527.168797:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788839527.168804:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060621696:12345-0@lo:503: 00000100:00100000:1.0:1788839527.168895:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060621696:12345-0@lo:503: Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.168901:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788839527.168941:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060621696:0@lo:503: 00000100:00100000:1.0:1788839527.169151:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8519:1875734060621824:0@lo:502: 00000100:00100000:1.0:1788839527.169183:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.169202:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621824 00000100:00100000:1.0:1788839527.169205:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621824 00000100:00100000:1.0:1788839527.169222:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788839527.169227:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8519:x1875734060621824:12345-0@lo:502: 00000100:00100000:1.0:1788839527.169294:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8519:x1875734060621824:12345-0@lo:502: Request processed in 66us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.169300:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788839527.169328:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777bc7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.169339:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8519:1875734060621824:0@lo:502: 00000100:00100000:1.0:1788839527.169377:0:8519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8519:1875734060621952:0@lo:502: 00000100:00100000:1.0:1788839527.169406:0:8519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.169423:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060621952 00000100:00100000:1.0:1788839527.169427:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060621952 00000100:00100000:1.0:1788839527.169442:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788839527.169453:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8519:x1875734060621952:12345-0@lo:502: 00000100:00100000:1.0:1788839527.169507:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:8519:x1875734060621952:12345-0@lo:502: Request processed in 53us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.169992:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788839527.170023:0:8519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777bc7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.170037:0:8519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8519:1875734060621952:0@lo:502: 00000040:00080000:1.0:1788839527.170058:0:8519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788839527.172445:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788839527.172484:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839527.172495:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.172507:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839527.172517:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839527.172520:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab74434b000 from 5 10000000:01000000:2.0:1788839527.172522:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839527.172561:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.172569:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.172592:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.172617:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622080:0@lo:101: 00000100:00100000:2.0:1788839527.172687:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.172736:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745c04240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.172887:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622080 00000100:00100000:0.0:1788839527.172895:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622080 00000100:00100000:0.0:1788839527.172937:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788839527.172945:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060622080:12345-0@lo:101: 00010000:00010000:0.0:1788839527.172958:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.172971:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572915 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.172995:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572915 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.173006:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572915 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.173020:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740030a00, rc 0) 00000100:00100000:0.0:1788839527.173070:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060622080:12345-0@lo:101: Request processed in 124us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.173076:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788839527.173149:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622080:0@lo:101: 00010000:00010000:1.0:1788839527.173165:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.173174:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839527.173227:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622208:0@lo:256: 00000100:00100000:1.0:1788839527.173259:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.173290:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777bc7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.173634:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622208 00000100:00100000:0.0:1788839527.173639:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622208 00000100:00100000:0.0:1788839527.173674:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788839527.173682:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060622208:12345-0@lo:256: 20000000:01000000:0.0:1788839527.173697:0:6479:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839527.173715:0:6479:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839527.173718:0:6479:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788839527.173834:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060622208:12345-0@lo:256: Request processed in 152us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.173845:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788839527.173887:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622208:0@lo:256: 10000000:01000000:0.0:1788839527.173933:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788839527.173940:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.173948:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839527.173955:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788839527.173958:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788839527.173960:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788839527.173982:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.173999:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.174008:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.174022:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622336:0@lo:101: 00000100:00100000:0.0:1788839527.174050:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.174070:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.174082:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622336 00000100:00100000:0.0:1788839527.174085:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622336 00000100:00100000:0.0:1788839527.174101:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839527.174107:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060622336:12345-0@lo:101: 00010000:00010000:0.0:1788839527.174114:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839527.174124:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572923 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.174139:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572923 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.174147:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572923 expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.174154:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740031200, rc 0) 00000100:00100000:0.0:1788839527.174180:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060622336:12345-0@lo:101: Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.174185:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839527.174211:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622336:0@lo:101: 00010000:00010000:0.0:1788839527.174227:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.174235:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.174289:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622464:0@lo:501: 00000100:00100000:0.0:1788839527.174313:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.174326:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.174337:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622464 00000100:00100000:0.0:1788839527.174340:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622464 00000100:00100000:0.0:1788839527.174357:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788839527.174363:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060622464:12345-0@lo:501: 00000100:00100000:0.0:1788839527.174478:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060622464:12345-0@lo:501: Request processed in 115us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.174485:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788839527.174512:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622464:0@lo:501: 00000100:00100000:0.0:1788839527.174537:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622592:0@lo:503: 00000100:00100000:0.0:1788839527.174579:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.174591:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.174601:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622592 00000100:00100000:0.0:1788839527.174604:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622592 00000100:00100000:0.0:1788839527.174620:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788839527.174625:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060622592:12345-0@lo:503: 00000100:00100000:0.0:1788839527.174699:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060622592:12345-0@lo:503: Request processed in 73us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.174705:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788839527.174746:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060622592:0@lo:503: 00000100:00100000:1.0:1788839527.176600:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8520:1875734060622720:0@lo:502: 00000100:00100000:1.0:1788839527.176672:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.176716:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777bc7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.176763:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622720 00000100:00100000:0.0:1788839527.176795:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622720 00000100:00100000:0.0:1788839527.176833:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788839527.176840:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:8520:x1875734060622720:12345-0@lo:502: 00000100:00100000:0.0:1788839527.176974:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:8520:x1875734060622720:12345-0@lo:502: Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.176982:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839527.177094:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8520:1875734060622720:0@lo:502: 00000020:01000000:3.0:1788839527.177124:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839527.177132:0:8520:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788839527.177139:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.177142:0:8520:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788839527.177147:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839527.177152:0:8520:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788839527.177178:0:8520:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788839527.177181:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839527.177196:0:8520:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ab646690000) 00000020:00000080:3.0:1788839527.177219:0:8520:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788839527.177226:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839527.177315:0:8520:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788839527.177323:0:8520:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788839527.177329:0:8520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26572938 00010000:00080000:3.0:1788839527.177360:0:8520:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab641af3800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839527.177611:0:8520:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788839527.191323:0:8520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788839527.191459:0:8520:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788839527.191683:0:8520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839527.192227:0:8520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839527.192318:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788839527.192519:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788839527.193299:0:8523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839527.193305:0:8523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788839527.195524:0:8520:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788839527.195539:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839527.195578:0:8520:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788839527.195600:0:8520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a2657293f 00000100:00080000:3.0:1788839527.195610:0:8520:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839527.195620:0:8520:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab641af3800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839527.195654:0:8520:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab641aed880 x1875734060622848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839527.195715:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060622848:0@lo:8: 00000100:00100000:0.0:1788839527.195809:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.195955:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622848 00000100:00100000:2.0:1788839527.195963:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622848 00000100:00100000:2.0:1788839527.195994:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839527.196001:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060622848:12345-0@lo:8: 00010000:00080000:2.0:1788839527.196036:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1788839527.196062:0:8403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26572946 00002000:00100000:2.0:1788839527.196092:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ab742bef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788839527.196097:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788839527.196101:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788839527.196165:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788839527.196497:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788839527.196523:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8ab742bed800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788839527.196638:0:8520:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788839527.196716:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839527.196721:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.196724:0:8520:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788839527.196727:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839527.196730:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.196731:0:8520:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839527.196734:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839527.196736:0:8520:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788839527.196763:0:8520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8520:1875734060622976:0@lo:502: 00000100:00100000:3.0:1788839527.196835:0:8520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.197149:0:8520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e59fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.199209:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060623104:0@lo:400: 00000100:00100000:1.0:1788839527.199282:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.199314:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060623616:0@lo:400: 00000100:00100000:1.0:1788839527.199340:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.199363:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839527.199369:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060623488:0@lo:400: 00000100:00100000:1.0:1788839527.199457:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839527.199496:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623104 00000100:00100000:1.0:1788839527.199502:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623104 00000100:00100000:3.0:1788839527.199544:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060623360:0@lo:400: 00000100:00100000:3.0:1788839527.199573:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.199594:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839527.199600:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060623232:0@lo:400: 00000100:00100000:3.0:1788839527.199621:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.199637:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060623744:0@lo:400: 00000100:00100000:3.0:1788839527.199653:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.199674:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623616 00000100:00100000:3.0:1788839527.199677:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623616 00000100:00100000:3.0:1788839527.199721:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623360 00000100:00100000:3.0:1788839527.199724:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623360 00000100:00100000:3.0:1788839527.199735:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623744 00000100:00100000:3.0:1788839527.199737:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623744 00000100:00100000:3.0:1788839527.199752:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839527.199767:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060623616:12345-0@lo:400: 00000100:00100000:3.0:1788839527.199829:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060623616:12345-0@lo:400: Request processed in 64us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.199836:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839527.199920:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839527.199926:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060623360:12345-0@lo:400: 00000100:00100000:3.0:1788839527.199959:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060623360:12345-0@lo:400: Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.199964:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839527.199975:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839527.199980:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060623744:12345-0@lo:400: 00000100:00100000:3.0:1788839527.200014:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060623744:12345-0@lo:400: Request processed in 24us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.200019:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788839527.200037:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839527.200041:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788839527.200076:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7486caa00 x1875734060623744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.200088:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060623744:0@lo:400: 00010000:00080000:3.0:1788839527.200097:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7486c8380 x1875734060623360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.200104:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060623360:0@lo:400: 00000100:00100000:2.0:1788839527.200259:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060622848:12345-0@lo:8: Request processed in 4254us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.200267:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839527.200307:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623488 00000100:00100000:2.0:1788839527.200312:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623488 00000100:00100000:2.0:1788839527.200329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623232 00000100:00100000:2.0:1788839527.200332:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623232 00000100:00100000:1.0:1788839527.200448:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839527.200455:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060623104:12345-0@lo:400: 00000100:00100000:2.0:1788839527.200476:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839527.200483:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060623488:12345-0@lo:400: 00000100:00100000:1.0:1788839527.200488:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060623104:12345-0@lo:400: Request processed in 34us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.200493:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788839527.200514:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060623488:12345-0@lo:400: Request processed in 32us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.200520:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839527.200532:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839527.200534:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060623488:0@lo:400: 00000100:00100000:2.0:1788839527.200538:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060623232:12345-0@lo:400: 00010000:00080000:1.0:1788839527.200544:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7486ca300 x1875734060623104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839527.200553:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060623104:0@lo:400: 00010000:00080000:1.0:1788839527.200563:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7486c8700 x1875734060623616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.200569:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060623232:12345-0@lo:400: Request processed in 32us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.200571:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060623616:0@lo:400: 00000100:00100000:2.0:1788839527.200575:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839527.200597:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060623232:0@lo:400: 00000100:00100000:2.0:1788839527.200616:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060622976 00000100:00100000:2.0:1788839527.200619:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060622976 00000100:00100000:2.0:1788839527.200694:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788839527.200702:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:8520:x1875734060622976:12345-0@lo:502: 00000100:00100000:2.0:1788839527.200941:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:8520:x1875734060622976:12345-0@lo:502: Request processed in 239us (4104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.200948:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788839527.201043:0:8520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8520:1875734060622976:0@lo:502: 00000020:01000000:3.0:1788839527.201074:0:8520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839527.201081:0:8520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.201090:0:8520:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788839527.201095:0:8520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00010000:00080000:0.0:1788839527.201290:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aed880 x1875734060622848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839527.201300:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839527.201308:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788839527.201316:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788839527.201322:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788839527.201326:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab641af3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788839527.201361:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788839527.201368:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060622848:0@lo:8: 00000004:00080000:0.0:1788839527.201390:0:8523:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788839527.201471:0:8523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 182145700036ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788839527.201477:0:8523:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788839527.202032:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060623872:0@lo:700: 00000100:00100000:3.0:1788839527.202077:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.202104:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab751752240 going to sleep for 11 seconds 00000020:01000000:0.0:1788839527.202180:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:0.0:1788839527.202206:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788839527.202217:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.202242:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839527.202253:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788839527.202256:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab745341000 from 30 10000000:01000000:0.0:1788839527.202259:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788839527.202286:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.202294:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.202303:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.202315:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624000:0@lo:101: 00000100:00100000:0.0:1788839527.202343:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.205802:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839527.206829:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060623872 00000100:00100000:0.0:1788839527.206847:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060623872 00000100:00100000:0.0:1788839527.206925:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839527.206936:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8524:x1875734060623872:12345-0@lo:700: 00000100:00100000:0.0:1788839527.206999:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8411:1875734060624128:0@lo:700: 00000100:00100000:0.0:1788839527.207222:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.207249:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6600 going to sleep for 11 seconds 00000100:00080000:0.0:1788839527.207264:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788839527.207321:0:7420:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788839527.207568:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624128 00000100:00100000:0.0:1788839527.207583:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624128 00000100:00100000:0.0:1788839527.207614:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839527.207621:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8411:x1875734060624128:12345-0@lo:700: 00000100:00100000:1.0:1788839527.208155:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624000 00000100:00100000:1.0:1788839527.208163:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624000 00000100:00100000:1.0:1788839527.208193:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788839527.208201:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060624000:12345-0@lo:101: 00010000:00010000:1.0:1788839527.208212:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839527.208232:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657294d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.208259:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657294d expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.208283:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657294d expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839527.208293:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553c00, rc 0) 00000100:00100000:1.0:1788839527.208364:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060624000:12345-0@lo:101: Request processed in 164us (6019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.208371:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788839527.208557:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624000:0@lo:101: 00010000:00010000:0.0:1788839527.208575:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839527.208585:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839527.208651:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624256:0@lo:501: 00000100:00100000:0.0:1788839527.208685:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.208718:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.208765:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624256 00000100:00100000:1.0:1788839527.208788:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624256 00000100:00100000:1.0:1788839527.208807:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788839527.208813:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060624256:12345-0@lo:501: 00000100:00100000:1.0:1788839527.208940:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060624256:12345-0@lo:501: Request processed in 127us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.208947:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839527.209120:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624256:0@lo:501: 00000100:00100000:0.0:1788839527.209168:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624384:0@lo:503: 00000100:00100000:0.0:1788839527.209205:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839527.209233:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6467f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.209580:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624384 00000100:00100000:1.0:1788839527.209585:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624384 00000100:00100000:1.0:1788839527.209606:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788839527.209612:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060624384:12345-0@lo:503: 00000100:00100000:1.0:1788839527.209701:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060624384:12345-0@lo:503: Request processed in 88us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.209708:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788839527.209807:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624384:0@lo:503: 00000100:00100000:2.0:1788839527.215043:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8526:1875734060624512:0@lo:502: 00000100:00100000:2.0:1788839527.215135:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.215179:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.215675:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624512 00000100:00100000:1.0:1788839527.215682:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624512 00000100:00100000:1.0:1788839527.215732:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788839527.215741:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:8526:x1875734060624512:12345-0@lo:502: 00000100:00100000:1.0:1788839527.215891:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:8526:x1875734060624512:12345-0@lo:502: Request processed in 150us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.215905:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788839527.216064:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8526:1875734060624512:0@lo:502: 00000100:00100000:2.0:1788839527.216122:0:8526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8526:1875734060624640:0@lo:502: 00000100:00100000:2.0:1788839527.216165:0:8526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.216200:0:8526:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 40000000:02000000:0.0:1788839527.216285:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788839527.216910:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624640 00000100:00100000:1.0:1788839527.216917:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624640 00000100:00100000:1.0:1788839527.216954:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788839527.216961:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:8526:x1875734060624640:12345-0@lo:502: 00000100:00100000:1.0:1788839527.217120:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:8526:x1875734060624640:12345-0@lo:502: Request processed in 158us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.217127:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788839527.217166:0:8526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8526:1875734060624640:0@lo:502: 00000040:00080000:2.0:1788839527.217261:0:8526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788839527.217339:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788839527.217361:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839527.217372:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217383:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839527.217393:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839527.217396:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab745341000 from 5 10000000:01000000:2.0:1788839527.217400:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839527.217425:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217433:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217443:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.217459:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624768:0@lo:101: 00000100:00100000:2.0:1788839527.217494:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.217533:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 00000100:00100000:2.0:1788839527.217550:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624768 00000100:00100000:2.0:1788839527.217554:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624768 00000100:00100000:2.0:1788839527.217596:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839527.217605:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060624768:12345-0@lo:101: 00010000:00010000:2.0:1788839527.217614:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839527.217628:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a2657295b expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217650:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a2657295b expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217662:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657295b expref: 19 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217671:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413ca800, rc 0) 00000100:00100000:2.0:1788839527.217704:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060624768:12345-0@lo:101: Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.217710:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839527.217742:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624768:0@lo:101: 00010000:00010000:2.0:1788839527.217754:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.217811:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.217866:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624896:0@lo:256: 00000100:00100000:2.0:1788839527.217895:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.217914:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.219179:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060624896 00000100:00100000:3.0:1788839527.219189:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060624896 00000100:00100000:3.0:1788839527.219250:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788839527.219258:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060624896:12345-0@lo:256: 20000000:01000000:3.0:1788839527.219279:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788839527.219301:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788839527.219307:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788839527.219423:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060624896:12345-0@lo:256: Request processed in 165us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.219430:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788839527.219476:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060624896:0@lo:256: 10000000:01000000:3.0:1788839527.219526:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839527.219535:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.219544:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839527.219553:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788839527.219555:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788839527.219558:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839527.219586:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.219901:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.219912:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839527.219932:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625024:0@lo:101: 00000100:00100000:3.0:1788839527.219960:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.219976:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab751752b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.219987:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625024 00000100:00100000:3.0:1788839527.219990:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625024 00000100:00100000:2.0:1788839527.220186:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788839527.220196:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060625024:12345-0@lo:101: 00010000:00010000:2.0:1788839527.220214:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839527.220226:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572969 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.220248:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572969 expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.220259:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572969 expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.220267:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cae00, rc 0) 00000100:00100000:2.0:1788839527.220302:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060625024:12345-0@lo:101: Request processed in 109us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.220308:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788839527.220335:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625024:0@lo:101: 00010000:00010000:2.0:1788839527.220347:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.220355:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.220409:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625152:0@lo:501: 00000100:00100000:2.0:1788839527.220433:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.220442:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.220455:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625152 00000100:00100000:1.0:1788839527.220463:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625152 00000100:00100000:1.0:1788839527.220595:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788839527.220602:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060625152:12345-0@lo:501: 00000100:00100000:1.0:1788839527.220699:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060625152:12345-0@lo:501: Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.220705:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788839527.221788:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625152:0@lo:501: 00000100:00100000:2.0:1788839527.221833:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625280:0@lo:503: 00000100:00100000:2.0:1788839527.221895:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.221932:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839527.221950:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625280 00000100:00100000:2.0:1788839527.221955:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625280 00000100:00100000:3.0:1788839527.224131:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788839527.224151:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060625280:12345-0@lo:503: 00000100:00100000:3.0:1788839527.224311:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060625280:12345-0@lo:503: Request processed in 167us (2415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.224319:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788839527.226205:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625280:0@lo:503: 00000100:00100000:2.0:1788839527.227291:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8529:1875734060625408:0@lo:502: 00000100:00100000:2.0:1788839527.227368:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.227407:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.227417:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625408 00000100:00100000:3.0:1788839527.227426:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625408 00000100:00100000:3.0:1788839527.227475:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788839527.227485:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:8529:x1875734060625408:12345-0@lo:502: 00000100:00100000:3.0:1788839527.227614:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:8529:x1875734060625408:12345-0@lo:502: Request processed in 130us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.227621:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788839527.228022:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8529:1875734060625408:0@lo:502: 00000020:01000000:2.0:1788839527.228057:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839527.228064:0:8529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788839527.228072:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839527.228074:0:8529:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788839527.228079:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788839527.228084:0:8529:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788839527.228215:0:8529:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788839527.228220:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839527.228237:0:8529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab646693370) 00000020:00000080:3.0:1788839527.228261:0:8529:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788839527.228274:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839527.228379:0:8529:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788839527.228385:0:8529:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788839527.228393:0:8529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a2657297e 00010000:00080000:3.0:1788839527.228432:0:8529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab781938800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839527.228668:0:8529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1788839527.230390:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8411:x1875734060624128:12345-0@lo:700: Request processed in 22717us (23116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.230403:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788839527.232114:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788839527.232157:0:8411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7766ed180 x1875734060624128/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.232173:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8411:1875734060624128:0@lo:700: 40000000:02000000:2.0:1788839527.232188:0:8411:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:3.0:1788839527.239218:0:8529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788839527.239245:0:8529:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788839527.239496:0:8529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839527.239718:0:8529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839527.240472:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788839527.240579:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788839527.242076:0:8530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839527.242082:0:8530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788839527.250269:0:8529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839527.250286:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839527.250327:0:8529:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788839527.250360:0:8529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26572985 00000100:00080000:3.0:1788839527.250371:0:8529:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839527.250377:0:8529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab781938800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839527.250406:0:8529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab641aed500 x1875734060625536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839527.250437:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060625536:0@lo:8: 00000100:00100000:3.0:1788839527.250505:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.250569:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625536 00000100:00100000:3.0:1788839527.250577:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625536 00000100:00100000:3.0:1788839527.250607:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839527.250615:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875734060625536:12345-0@lo:8: 00010000:00080000:3.0:1788839527.250639:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:3.0:1788839527.250666:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a2657298c 00002000:00100000:3.0:1788839527.250686:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab78193c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788839527.250691:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788839527.250694:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1788839527.250750:0:8529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788839527.251135:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839527.251141:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.251144:0:8529:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788839527.251147:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839527.251151:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.251152:0:8529:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839527.251156:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839527.251158:0:8529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788839527.251186:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8529:1875734060625664:0@lo:502: 00000100:00100000:3.0:1788839527.251237:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.251265:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625664 00000100:00100000:3.0:1788839527.251270:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625664 00000100:00100000:3.0:1788839527.251301:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788839527.251307:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:8529:x1875734060625664:12345-0@lo:502: 00000100:00100000:3.0:1788839527.251408:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:8529:x1875734060625664:12345-0@lo:502: Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.251417:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788839527.251456:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744663840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.251474:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:8529:1875734060625664:0@lo:502: 00000020:01000000:3.0:1788839527.251497:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839527.251501:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839527.251502:0:8529:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788839527.251505:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788839527.251561:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788839527.251582:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788839527.251596:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.251607:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839527.251616:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788839527.251619:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab7486e8000 from 1 10000000:01000000:3.0:1788839527.251622:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839527.251645:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.251654:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.251663:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839527.251674:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625792:0@lo:101: 00000100:00100000:3.0:1788839527.251700:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.251715:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744663840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.251728:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625792 00000100:00100000:3.0:1788839527.251731:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625792 00000100:00100000:3.0:1788839527.251752:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788839527.251758:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060625792:12345-0@lo:101: 00010000:00010000:3.0:1788839527.251766:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839527.251796:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572993 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.251817:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572993 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.251833:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572993 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.253219:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078a00, rc 0) 00000100:00100000:3.0:1788839527.253295:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060625792:12345-0@lo:101: Request processed in 1533us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.253302:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788839527.253694:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625792:0@lo:101: 00010000:00010000:2.0:1788839527.253715:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839527.253726:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839527.253824:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625920:0@lo:501: 00000100:00100000:2.0:1788839527.253888:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.253910:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.254091:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060625920 00000100:00100000:3.0:1788839527.254098:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060625920 00000100:00100000:3.0:1788839527.254138:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788839527.254147:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060625920:12345-0@lo:501: 00000100:00100000:3.0:1788839527.254229:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060625920:12345-0@lo:501: Request processed in 83us (341us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839527.254236:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788839527.254270:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060625920:0@lo:501: 10000000:01000000:3.0:1788839527.254296:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788839527.254302:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839527.254311:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788839527.255127:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788839527.255155:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab78193e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839527.255246:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060625536:12345-0@lo:8: Request processed in 4631us (4741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.255255:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788839527.255543:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aed500 x1875734060625536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839527.255564:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839527.255571:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788839527.255578:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788839527.255583:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788839527.255585:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab781938800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788839527.255608:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788839527.255613:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060625536:0@lo:8: 00000004:00080000:3.0:1788839527.255662:0:8530:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788839527.255714:0:8530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 182199943573ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788839527.255719:0:8530:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788839527.259195:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000001:00100000:1.0:1788839527.267320:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788839527.267496:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8524:x1875734060623872:12345-0@lo:700: Request processed in 60557us (65412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.267513:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788839527.267620:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aef800 x1875734060623872/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.267635:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060623872:0@lo:700: 00000100:00100000:2.0:1788839527.268133:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839527.268149:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060626048:0@lo:13: 00000100:00100000:2.0:1788839527.268191:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788839527.268227:0:8531:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788839527.268246:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060626176:0@lo:7: 00000100:00100000:2.0:1788839527.268269:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.268293:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626176 00000100:00100000:2.0:1788839527.268299:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626176 00000100:00100000:2.0:1788839527.268350:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839527.268358:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8531:x1875734060626176:12345-0@lo:7: 00000100:00100000:1.0:1788839527.269293:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626048 00000100:00100000:1.0:1788839527.269301:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626048 00000100:00100000:1.0:1788839527.269341:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839527.269350:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060626048:12345-0@lo:13: 00002000:00000024:1.0:1788839527.269369:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:1.0:1788839527.269423:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060626048:12345-0@lo:13: Request processed in 74us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.269430:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788839527.274262:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839527.274323:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.281236:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839527.281263:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060626304:0@lo:13: 00000100:00100000:3.0:1788839527.281339:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.281400:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626304 00000100:00100000:3.0:1788839527.281408:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626304 00000100:00100000:3.0:1788839527.281457:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839527.281466:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060626304:12345-0@lo:13: 00002000:00000024:3.0:1788839527.281487:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:3.0:1788839527.281528:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060626304:12345-0@lo:13: Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.281535:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839527.281575:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aef800 x1875734060626304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.281593:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060626304:0@lo:13: 00000004:00080000:3.0:1788839527.281612:0:8524:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788839527.281632:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060626432:0@lo:7: 00000100:00100000:3.0:1788839527.281659:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.281682:0:8405:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788839527.281688:0:8405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788839527.281808:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab751752240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839527.283393:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626432 00000100:00100000:3.0:1788839527.283411:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626432 00010000:00080000:2.0:1788839527.283543:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7443daa00 x1875734060626048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.283567:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060626048:0@lo:13: 00000100:00100000:1.0:1788839527.284187:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839527.284203:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8524:x1875734060626432:12345-0@lo:7: 00002000:00080000:2.0:1788839527.289487:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788839527.289498:0:8404:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788839527.289633:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8531:x1875734060626176:12345-0@lo:7: Request processed in 21271us (21358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.289644:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788839527.293137:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7443d9180 x1875734060626176/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.293156:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060626176:0@lo:7: 00000004:00080000:3.0:1788839527.293171:0:8531:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788839527.293215:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060626560:0@lo:5: 00000100:00100000:3.0:1788839527.293274:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.293357:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00002000:00080000:1.0:1788839527.295737:0:8538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788839527.295745:0:8538:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00010000:00080000:3.0:1788839527.297038:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aef800 x1875734060626432/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.297056:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060626432:0@lo:7: 00000004:00080000:3.0:1788839527.297071:0:8524:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788839527.297112:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060626688:0@lo:5: 00000100:00100000:2.0:1788839527.298117:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626560 00000100:00100000:2.0:1788839527.298127:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626560 00000100:00100000:2.0:1788839527.298178:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839527.298188:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8531:x1875734060626560:12345-0@lo:5: 00002000:00080000:2.0:1788839527.298225:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788839527.298229:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788839527.303486:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.303537:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab751752240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839527.303684:0:8404:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788839527.303693:0:8404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000001:00080000:2.0:1788839527.305737:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788839527.305757:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788839527.305921:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8531:x1875734060626560:12345-0@lo:5: Request processed in 7728us (12640us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788839527.305931:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839527.305958:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626688 00000100:00100000:2.0:1788839527.305966:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626688 00000100:00100000:2.0:1788839527.306001:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839527.306120:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8524:x1875734060626688:12345-0@lo:5: 00002000:00080000:2.0:1788839527.306149:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788839527.306183:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8524:x1875734060626688:12345-0@lo:5: Request processed in 66us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839527.306189:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839527.306819:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8524:x1875734060626432:12345-0@lo:7: Request processed in 22617us (25156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.306828:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788839527.307209:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aee300 x1875734060626560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.307221:0:8531:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788839527.307228:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060626560:0@lo:5: 00000004:00080000:2.0:1788839527.307243:0:8531:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788839527.307287:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060626816:0@lo:700: 00000100:00100000:2.0:1788839527.307325:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.307357:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.307412:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626816 00000100:00100000:1.0:1788839527.307416:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626816 00000100:00100000:1.0:1788839527.307452:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839527.307459:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8531:x1875734060626816:12345-0@lo:700: 00010000:00080000:2.0:1788839527.307966:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aef800 x1875734060626688/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.307989:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060626688:0@lo:5: 00000004:00080000:2.0:1788839527.307998:0:8524:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788839527.308035:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060626944:0@lo:5: 00000100:00100000:2.0:1788839527.308071:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.308098:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060626944 00000100:00100000:2.0:1788839527.308102:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060626944 00000100:00100000:2.0:1788839527.308128:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839527.308135:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8524:x1875734060626944:12345-0@lo:5: 00002000:00080000:2.0:1788839527.308164:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788839527.309896:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8524:x1875734060626944:12345-0@lo:5: Request processed in 1757us (1819us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788839527.309907:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839527.310004:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52780 going to sleep for 11 seconds 00010000:00080000:2.0:1788839527.310032:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7443d9180 x1875734060626944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.310047:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8524:1875734060626944:0@lo:5: 00000004:00080000:2.0:1788839527.310060:0:8524:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788839527.310097:0:8524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8524:1875734060627072:0@lo:900: 00000100:00100000:2.0:1788839527.310127:0:8524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.310155:0:8524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52780 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.310413:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627072 00000100:00100000:1.0:1788839527.310420:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627072 00000100:00100000:1.0:1788839527.310464:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839527.310472:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8524:x1875734060627072:12345-0@lo:900: 00000100:00100000:1.0:1788839527.310521:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8524:x1875734060627072:12345-0@lo:900: Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839527.310527:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788839527.314430:0:8524:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819b0e00 x1875734060627072/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.314450:0:8524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8524:1875734060627072:0@lo:900: 00000001:00080000:2.0:1788839527.328821:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1788839527.329213:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8531:x1875734060626816:12345-0@lo:700: Request processed in 21750us (21883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839527.329225:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788839527.329956:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7443daa00 x1875734060626816/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839527.329973:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443daa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060626816:0@lo:700: 00000004:02000040:2.0:1788839527.335793:0:8531:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788839527.340192:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060627200:0@lo:5: 00000100:00100000:2.0:1788839527.340266:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839527.340328:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff523c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839527.340348:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627200 00000100:00100000:1.0:1788839527.340357:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627200 00000100:00100000:1.0:1788839527.340410:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788839527.340419:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8531:x1875734060627200:12345-0@lo:5: 00002000:00080000:1.0:1788839527.359227:0:8538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788839527.359251:0:8538:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788839527.360671:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8531:x1875734060627200:12345-0@lo:5: Request processed in 20245us (20397us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788839527.360683:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788839527.360887:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819b0e00 x1875734060627200/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839543 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839527.360904:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8531:1875734060627200:0@lo:5: 00000004:00080000:3.0:1788839527.360920:0:8531:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:3.0:1788839527.811017:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839527.811043:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060627328:0@lo:41: 00000100:00100000:3.0:1788839527.811115:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839527.811185:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627328 00000100:00100000:3.0:1788839527.811193:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627328 00000100:00100000:3.0:1788839527.811255:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839527.811264:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060627328:12345-0@lo:41: 00000004:00000024:3.0:1788839527.811324:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788839527.811420:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060627328:12345-0@lo:41: Request processed in 157us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839527.811427:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839527.811483:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060627328:0@lo:41: 00010000:00010000:2.0:1788839528.256506:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839529.281683:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839529.861072:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060627456:0@lo:41: 00000100:00100000:3.0:1788839529.861142:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839529.861240:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627456 00000100:00100000:0.0:1788839529.861247:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627456 00000100:00100000:0.0:1788839529.861293:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788839529.861301:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060627456:12345-0@lo:41: 00000004:00000024:0.0:1788839529.861333:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788839529.869094:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060627456:12345-0@lo:41: Request processed in 7785us (7944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839529.869110:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839529.869490:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060627456:0@lo:41: 00010000:00010000:1.0:1788839530.305481:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839531.327369:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839531.497028:0:8781:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788839532.356289:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839532.415598:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060627968:0@lo:400: 00000100:00100000:3.0:1788839532.415662:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.415711:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060628480:0@lo:400: 00000100:00100000:3.0:1788839532.415730:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.415755:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788839532.415759:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060627584:0@lo:400: 00000100:00100000:3.0:1788839532.415803:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.415843:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060628096:0@lo:400: 00000100:00100000:3.0:1788839532.415864:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.415878:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060628608:0@lo:400: 00000100:00100000:3.0:1788839532.415911:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.415939:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060627712:0@lo:400: 00000100:00100000:3.0:1788839532.415961:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.415977:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060628224:0@lo:400: 00000100:00100000:3.0:1788839532.415995:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.416031:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788839532.416045:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060627840:0@lo:400: 00000100:00100000:3.0:1788839532.416068:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.416085:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060628352:0@lo:400: 00000100:00100000:3.0:1788839532.416104:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839532.416134:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627968 00000100:00100000:3.0:1788839532.416141:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627968 00000100:00100000:3.0:1788839532.416173:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627712 00000100:00100000:3.0:1788839532.416176:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627712 00000100:00100000:3.0:1788839532.416188:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628224 00000100:00100000:3.0:1788839532.416190:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628224 00000100:00100000:3.0:1788839532.416207:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628352 00000100:00100000:3.0:1788839532.416209:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628352 00000100:00100000:3.0:1788839532.416224:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839532.416231:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060627968:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416279:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060627968:12345-0@lo:400: Request processed in 48us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416286:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839532.416301:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839532.416307:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060627712:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416332:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060627712:12345-0@lo:400: Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416338:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839532.416348:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839532.416353:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060628224:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416372:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060628224:12345-0@lo:400: Request processed in 19us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416377:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839532.416386:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839532.416397:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060628352:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416418:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060628352:12345-0@lo:400: Request processed in 22us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416423:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788839532.416438:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627584 00000100:00100000:3.0:1788839532.416441:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627584 00000100:00100000:3.0:1788839532.416460:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788839532.416465:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:3614:x1875734060627584:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416488:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:3614:x1875734060627584:12345-0@lo:400: Request processed in 23us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416493:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788839532.416517:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628480 00000100:00100000:3.0:1788839532.416520:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628480 00000100:00100000:3.0:1788839532.416540:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628608 00000100:00100000:3.0:1788839532.416543:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628608 00000100:00100000:3.0:1788839532.416560:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839532.416566:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060628480:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416591:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060628480:12345-0@lo:400: Request processed in 25us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416597:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839532.416605:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839532.416610:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060628608:12345-0@lo:400: 00000100:00100000:3.0:1788839532.416628:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060628608:12345-0@lo:400: Request processed in 18us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839532.416633:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839532.416668:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777c35180 x1875734060628352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839532.416693:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060628352:0@lo:400: 00010000:00080000:3.0:1788839532.416704:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aed180 x1875734060627712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839532.416712:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060627712:0@lo:400: 00010000:00080000:3.0:1788839532.416719:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777c34e00 x1875734060628224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839532.416727:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060628224:0@lo:400: 00000100:00100000:3.0:1788839532.416752:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060627584:0@lo:400: 00010000:00080000:3.0:1788839532.416760:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777c34a80 x1875734060628608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839532.416792:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060628608:0@lo:400: 00010000:00080000:3.0:1788839532.416800:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aee300 x1875734060627968/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839532.416808:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060627968:0@lo:400: 00010000:00080000:3.0:1788839532.416816:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777c34000 x1875734060628480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839532.416835:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788839532.416844:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060628480:0@lo:400: 00000100:00100000:1.0:1788839532.417393:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628096 00000100:00100000:1.0:1788839532.417399:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628096 00000100:00100000:1.0:1788839532.417423:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060627840 00000100:00100000:1.0:1788839532.417426:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060627840 00000100:00100000:1.0:1788839532.417437:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839532.417443:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060628096:12345-0@lo:400: 00000100:00100000:1.0:1788839532.417506:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060628096:12345-0@lo:400: Request processed in 62us (1640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839532.417512:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839532.417525:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788839532.417530:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060627840:12345-0@lo:400: 00000100:00100000:1.0:1788839532.417567:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060627840:12345-0@lo:400: Request processed in 37us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839532.417572:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788839532.417591:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839532.417596:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839532.417598:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839532.417665:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060627840:0@lo:400: 00000100:00100000:2.0:1788839532.419012:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839532.419031:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060628736:0@lo:13: 00000100:00100000:2.0:1788839532.419126:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839532.419158:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628736 00000100:00100000:0.0:1788839532.419166:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628736 00000100:00100000:0.0:1788839532.419209:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839532.419287:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060628736:12345-0@lo:13: 00002000:00000024:0.0:1788839532.419377:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839532.419422:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060628736:12345-0@lo:13: Request processed in 139us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839532.419438:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839532.419489:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060628096:0@lo:400: 00000100:00100000:1.0:1788839532.419563:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839532.419573:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060628864:0@lo:13: 00000100:00100000:1.0:1788839532.419606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788839532.419609:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819b3b80 x1875734060628736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839532.419626:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060628736:0@lo:13: 00000100:00100000:2.0:1788839532.419713:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628864 00000100:00100000:2.0:1788839532.419718:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628864 00000100:00100000:2.0:1788839532.419737:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839532.419742:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060628864:12345-0@lo:13: 00002000:00000024:2.0:1788839532.419752:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839532.419810:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060628864:12345-0@lo:13: Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839532.419816:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839532.420051:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e41f80 x1875734060628864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839532.420145:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060628864:0@lo:13: 00000020:00000004:1.0:1788839532.424086:0:8833:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839532.424317:0:8833:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788839532.928102:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060628992:0@lo:41: 00000100:00100000:3.0:1788839532.928856:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839532.930667:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060628992 00000100:00100000:1.0:1788839532.930679:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060628992 00000100:00100000:1.0:1788839532.930739:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839532.930749:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060628992:12345-0@lo:41: 00000004:00000024:0.0:1788839532.933200:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788839532.933309:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060628992:12345-0@lo:41: Request processed in 2559us (4451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839532.933319:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839532.933434:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060628992:0@lo:41: 00000001:00080000:2.0:1788839532.938687:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788839533.376045:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839534.399563:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839534.975883:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839534.975915:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060629120:0@lo:41: 00000100:00100000:3.0:1788839534.976133:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839534.976417:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629120 00000100:00100000:1.0:1788839534.976426:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629120 00000100:00100000:1.0:1788839534.976482:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839534.976492:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060629120:12345-0@lo:41: 00000004:00000024:1.0:1788839534.976526:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788839534.976574:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060629120:12345-0@lo:41: Request processed in 84us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839534.976581:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788839534.977123:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060629120:0@lo:41: 00000020:00000004:3.0:1788839535.216056:0:8934:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839535.216292:0:8934:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788839535.425910:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788839536.179966:0:8983:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839536.179978:0:8983:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788839536.453087:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839537.474520:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839537.549278:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060629504:0@lo:400: 00000100:00100000:3.0:1788839537.549349:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839537.549398:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060630016:0@lo:400: 00000100:00100000:3.0:1788839537.549424:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839537.549450:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788839537.549455:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060629632:0@lo:400: 00000100:00100000:3.0:1788839537.549476:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839537.549497:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060630144:0@lo:400: 00000100:00100000:3.0:1788839537.549517:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839537.549551:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629504 00000100:00100000:3.0:1788839537.549559:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629504 00000100:00100000:3.0:1788839537.549609:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839537.549617:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060629504:12345-0@lo:400: 00000100:00100000:3.0:1788839537.549671:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060629504:12345-0@lo:400: Request processed in 55us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839537.549679:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839537.549702:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630016 00000100:00100000:3.0:1788839537.549706:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630016 00000100:00100000:3.0:1788839537.549739:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629632 00000100:00100000:3.0:1788839537.549742:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629632 00000100:00100000:3.0:1788839537.549762:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788839537.549812:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060630016:12345-0@lo:400: 00000100:00100000:3.0:1788839537.549843:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060630016:12345-0@lo:400: Request processed in 33us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839537.549848:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788839537.549860:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839537.549865:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060629632:12345-0@lo:400: 00000100:00100000:3.0:1788839537.549891:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060629632:12345-0@lo:400: Request processed in 25us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839537.549896:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839537.549920:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630144 00000100:00100000:3.0:1788839537.549923:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630144 00000100:00100000:3.0:1788839537.549947:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839537.549954:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060630144:12345-0@lo:400: 00000100:00100000:3.0:1788839537.549978:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060630144:12345-0@lo:400: Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839537.549983:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788839537.550000:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839537.550004:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788839537.550037:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e42300 x1875734060629632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839537.550052:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060629632:0@lo:400: 00010000:00080000:3.0:1788839537.550062:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e40380 x1875734060630144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839537.550070:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060630144:0@lo:400: 00000100:00100000:3.0:1788839537.550078:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060629504:0@lo:400: 00010000:00080000:3.0:1788839537.550098:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e43100 x1875734060630016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839537.550106:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060630016:0@lo:400: 00000100:00100000:0.0:1788839537.550264:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060629248:0@lo:400: 00000100:00100000:0.0:1788839537.550297:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839537.550318:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060629760:0@lo:400: 00000100:00100000:0.0:1788839537.550340:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839537.550357:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060630272:0@lo:400: 00000100:00100000:0.0:1788839537.550378:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839537.550397:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788839537.550402:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060629376:0@lo:400: 00000100:00100000:0.0:1788839537.550423:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839537.550437:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060629888:0@lo:400: 00000100:00100000:0.0:1788839537.550457:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839537.550632:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630272 00000100:00100000:0.0:1788839537.550637:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630272 00000100:00100000:0.0:1788839537.550671:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839537.550677:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060630272:12345-0@lo:400: 00000100:00100000:0.0:1788839537.550710:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060630272:12345-0@lo:400: Request processed in 33us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839537.550716:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839537.550738:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629376 00000100:00100000:0.0:1788839537.550741:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629376 00000100:00100000:0.0:1788839537.550760:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629888 00000100:00100000:0.0:1788839537.550762:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629888 00000100:00100000:0.0:1788839537.550812:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839537.550817:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060629376:12345-0@lo:400: 00000100:00100000:0.0:1788839537.550843:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060629376:12345-0@lo:400: Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839537.550848:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839537.550858:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839537.550863:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060629888:12345-0@lo:400: 00000100:00100000:0.0:1788839537.550883:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060629888:12345-0@lo:400: Request processed in 20us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839537.550888:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788839537.550901:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839537.550904:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839537.550911:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629760 00000100:00100000:0.0:1788839537.550914:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629760 00000100:00100000:0.0:1788839537.550931:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788839537.550936:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060629760:12345-0@lo:400: 00000100:00100000:0.0:1788839537.550959:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060629760:12345-0@lo:400: Request processed in 23us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839537.550971:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1788839537.551000:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e41500 x1875734060629376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839537.551011:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060629376:0@lo:400: 00010000:00080000:0.0:1788839537.551019:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e41180 x1875734060629888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839537.551027:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060629888:0@lo:400: 00000100:00100000:0.0:1788839537.551036:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060629760:0@lo:400: 00010000:00080000:0.0:1788839537.551045:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e42d80 x1875734060630272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839537.551052:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788839537.551062:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060630272:0@lo:400: 00000100:00100000:0.0:1788839537.551072:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839537.551079:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060630400:0@lo:13: 00000100:00100000:0.0:1788839537.551102:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839537.551124:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630400 00000100:00100000:0.0:1788839537.551127:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630400 00000100:00100000:0.0:1788839537.551148:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839537.551153:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060630400:12345-0@lo:13: 00002000:00000024:0.0:1788839537.551172:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839537.551202:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060630400:12345-0@lo:13: Request processed in 49us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839537.551207:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788839537.551230:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7766eea00 x1875734060630400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839537.551247:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060630400:0@lo:13: 00000100:00100000:3.0:1788839537.551352:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839537.551360:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060630528:0@lo:13: 00000100:00100000:3.0:1788839537.551384:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839537.551408:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630528 00000100:00100000:3.0:1788839537.551411:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630528 00000100:00100000:3.0:1788839537.551432:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839537.551437:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060630528:12345-0@lo:13: 00002000:00000024:3.0:1788839537.551447:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839537.551473:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060630528:12345-0@lo:13: Request processed in 36us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839537.551479:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788839537.551503:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab641aef100 x1875734060630528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839537.551514:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060630528:0@lo:13: 00000100:00100000:2.0:1788839537.551614:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060629248 00000100:00100000:2.0:1788839537.551618:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060629248 00000100:00100000:2.0:1788839537.551643:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788839537.551649:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:3616:x1875734060629248:12345-0@lo:400: 00000100:00100000:2.0:1788839537.551687:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:3616:x1875734060629248:12345-0@lo:400: Request processed in 39us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839537.551700:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839537.552030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060629248:0@lo:400: 00000100:00100000:1.0:1788839538.049540:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839538.049566:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060630656:0@lo:41: 00000100:00100000:1.0:1788839538.049632:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839538.050578:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630656 00000100:00100000:3.0:1788839538.050588:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630656 00000100:00100000:3.0:1788839538.050642:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839538.050650:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060630656:12345-0@lo:41: 00000004:00000024:3.0:1788839538.050683:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788839538.050748:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060630656:12345-0@lo:41: Request processed in 98us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839538.050754:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839538.051119:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060630656:0@lo:41: 00010000:00010000:1.0:1788839538.497169:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839539.519012:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839540.096030:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839540.096065:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060630784:0@lo:41: 00000100:00100000:3.0:1788839540.096136:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839540.096296:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630784 00000100:00100000:1.0:1788839540.096305:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630784 00000100:00100000:1.0:1788839540.096361:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839540.096371:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060630784:12345-0@lo:41: 00000004:00000024:1.0:1788839540.096407:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788839540.096458:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060630784:12345-0@lo:41: Request processed in 88us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839540.096465:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839540.096516:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060630784:0@lo:41: 00010000:00010000:1.0:1788839540.542939:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839541.567260:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839542.590862:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839542.655023:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060631296:0@lo:400: 00000100:00100000:3.0:1788839542.655097:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839542.655131:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060630912:0@lo:400: 00000100:00100000:3.0:1788839542.655151:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060631808:0@lo:400: 00000100:00100000:1.0:1788839542.655174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839542.655186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839542.655208:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060631424:0@lo:400: 00000100:00100000:3.0:1788839542.655232:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060631168:0@lo:400: 00000100:00100000:1.0:1788839542.655239:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839542.655262:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060631936:0@lo:400: 00000100:00100000:3.0:1788839542.655268:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839542.655290:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839542.655295:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060631680:0@lo:400: 00000100:00100000:3.0:1788839542.655323:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839542.655340:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060631040:0@lo:400: 00000100:00100000:1.0:1788839542.655369:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839542.655387:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060631552:0@lo:400: 00000100:00100000:1.0:1788839542.655405:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839542.655481:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631296 00000100:00100000:3.0:1788839542.655488:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631296 00000100:00100000:1.0:1788839542.655496:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060630912 00000100:00100000:1.0:1788839542.655502:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060630912 00000100:00100000:3.0:1788839542.655527:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631680 00000100:00100000:3.0:1788839542.655532:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631680 00000100:00100000:1.0:1788839542.655541:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788839542.655552:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060630912:12345-0@lo:400: 00000100:00100000:3.0:1788839542.655564:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631040 00000100:00100000:3.0:1788839542.655568:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631040 00000100:00100000:3.0:1788839542.655582:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631552 00000100:00100000:3.0:1788839542.655585:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631552 00000100:00100000:3.0:1788839542.655604:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839542.655604:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060630912:12345-0@lo:400: Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839542.655613:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060631296:12345-0@lo:400: 00000100:00100000:1.0:1788839542.655617:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788839542.655652:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631424 00000100:00100000:1.0:1788839542.655656:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631424 00000100:00100000:3.0:1788839542.655665:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060631296:12345-0@lo:400: Request processed in 51us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839542.655673:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631168 00000100:00100000:3.0:1788839542.655674:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839542.655678:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631168 00000100:00100000:1.0:1788839542.655698:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788839542.655701:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788839542.655709:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060631424:12345-0@lo:400: 00000100:00100000:3.0:1788839542.655714:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060631680:12345-0@lo:400: 00000100:00100000:3.0:1788839542.655762:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060631680:12345-0@lo:400: Request processed in 44us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839542.655791:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060631424:12345-0@lo:400: Request processed in 84us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839542.655803:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788839542.655808:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788839542.655822:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839542.655830:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839542.655833:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060631168:12345-0@lo:400: 00000100:00100000:3.0:1788839542.655841:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060631040:12345-0@lo:400: 00000100:00100000:1.0:1788839542.655866:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060631168:12345-0@lo:400: Request processed in 36us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839542.655874:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839542.655888:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060631040:12345-0@lo:400: Request processed in 49us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839542.655897:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839542.655897:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631808 00000100:00100000:1.0:1788839542.655903:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631808 00000100:00100000:3.0:1788839542.655913:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839542.655921:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060631552:12345-0@lo:400: 00000100:00100000:1.0:1788839542.655934:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060631936 00000100:00100000:1.0:1788839542.655938:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060631936 00000100:00100000:3.0:1788839542.655952:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060631552:12345-0@lo:400: Request processed in 32us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839542.655959:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839542.655967:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839542.655977:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060631808:12345-0@lo:400: 00000100:00100000:3.0:1788839542.655984:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839542.655994:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060631936:12345-0@lo:400: 00000100:00100000:1.0:1788839542.656027:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060631808:12345-0@lo:400: Request processed in 51us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839542.656036:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060631936:12345-0@lo:400: Request processed in 43us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839542.656036:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839542.656047:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839542.656085:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060630912:0@lo:400: 00000100:00100000:1.0:1788839542.656097:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060631424:0@lo:400: 00010000:00080000:1.0:1788839542.656110:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e42300 x1875734060631936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839542.656120:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060631936:0@lo:400: 00010000:00080000:1.0:1788839542.656148:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e42d80 x1875734060631040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839542.656158:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060631040:0@lo:400: 00010000:00080000:1.0:1788839542.656174:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e43100 x1875734060631552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839542.656182:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060631552:0@lo:400: 00000100:00100000:3.0:1788839542.656249:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060631168:0@lo:400: 00010000:00080000:3.0:1788839542.656262:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e41c00 x1875734060631680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839542.656272:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060631680:0@lo:400: 00010000:00080000:3.0:1788839542.656301:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e41180 x1875734060631296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839542.656311:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060631296:0@lo:400: 00010000:00080000:3.0:1788839542.656322:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777e40380 x1875734060631808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839542.656340:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060631808:0@lo:400: 00000100:00080000:0.0:1788839542.657330:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839542.657338:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839542.657340:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839542.657825:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060632192:0@lo:13: 00000100:00100000:2.0:1788839542.657898:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839542.657934:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839542.657940:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060632064:0@lo:13: 00000100:00100000:2.0:1788839542.657963:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839542.659297:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632192 00000100:00100000:3.0:1788839542.659307:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632192 00000100:00100000:3.0:1788839542.659352:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632064 00000100:00100000:3.0:1788839542.659355:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632064 00000100:00100000:3.0:1788839542.659376:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839542.659385:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060632192:12345-0@lo:13: 00002000:00000024:3.0:1788839542.659418:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839542.660105:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060632192:12345-0@lo:13: Request processed in 718us (2203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839542.660114:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788839542.660142:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819b1500 x1875734060632192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839542.660165:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060632192:0@lo:13: 00000100:00100000:3.0:1788839542.660539:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839542.660551:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060632064:12345-0@lo:13: 00002000:00000024:3.0:1788839542.660569:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839542.660613:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060632064:12345-0@lo:13: Request processed in 65us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839542.660619:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788839542.661596:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819b3480 x1875734060632064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839558 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839542.661616:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060632064:0@lo:13: 00000100:00100000:0.0:1788839543.167086:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060632320:0@lo:41: 00000100:00100000:0.0:1788839543.167164:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839543.167300:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632320 00000100:00100000:3.0:1788839543.167309:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632320 00000100:00100000:3.0:1788839543.167377:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839543.167388:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060632320:12345-0@lo:41: 00000004:00000024:3.0:1788839543.167438:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788839543.167484:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060632320:12345-0@lo:41: Request processed in 99us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839543.167491:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788839543.167632:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060632320:0@lo:41: 00010000:00010000:0.0:1788839543.623601:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839544.642140:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839545.215119:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839545.215163:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060632448:0@lo:41: 00000100:00100000:3.0:1788839545.215236:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839545.215405:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632448 00000100:00100000:1.0:1788839545.215414:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632448 00000100:00100000:1.0:1788839545.215470:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839545.215491:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060632448:12345-0@lo:41: 00000004:00000024:1.0:1788839545.215523:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788839545.215573:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060632448:12345-0@lo:41: Request processed in 94us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839545.215580:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839545.215623:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060632448:0@lo:41: 00010000:00010000:0.0:1788839545.674990:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788839546.449607:0:9481:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788839546.449611:0:9481:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788839546.449612:0:9481:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788839546.449762:0:9481:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab646536000 00000020:01000004:2.0:1788839546.452894:0:9481:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788839546.452913:0:9481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788839546.452930:0:9481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab777fb0000) 00000020:00000080:2.0:1788839546.452953:0:9481:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788839546.492749:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788839546.492834:0:9481:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788839546.525499:0:9481:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788839546.526374:0:9481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788839546.526389:0:9481:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839546.526405:0:9481:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xad5b343a265729a8 00000020:01000004:2.0:1788839546.526412:0:9481:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788839546.526436:0:9481:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788839546.526440:0:9481:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788839546.526447:0:9481:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788839546.526477:0:9481:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788839546.526481:0:9481:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788839546.555765:0:9481:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788839546.555836:0:9481:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788839546.555841:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788839546.555843:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839546.555844:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839546.555845:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839546.555847:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839546.555848:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839546.555849:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839546.555850:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839546.555856:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839546.555858:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839546.555859:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839546.555862:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788839546.555865:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839546.555866:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839546.555867:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839546.555868:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839546.555868:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839546.555869:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839546.555870:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839546.555871:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839546.555872:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839546.555873:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839546.555873:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839546.555901:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788839546.555922:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060632576:0@lo:253: 00000100:00100000:2.0:1788839546.555994:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.556051:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839546.558792:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632576 00000100:00100000:1.0:1788839546.558807:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632576 00000100:00100000:1.0:1788839546.558864:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788839546.558874:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:9481:x1875734060632576:12345-0@lo:253: 20000000:01000000:1.0:1788839546.558941:0:6480:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788839546.558946:0:6480:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788839546.558952:0:6480:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788839546.558956:0:6480:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788839546.559259:0:6480:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839546.559408:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788839546.559423:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788839546.559441:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788839546.559447:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788839546.559461:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788839546.559478:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788839546.559566:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788839546.559582:0:6480:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:1.0:1788839546.559584:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788839546.559599:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788839546.559606:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788839546.559621:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788839546.559628:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788839546.559644:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788839546.559651:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788839546.559665:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788839546.559682:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788839546.560275:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788839546.560292:0:6480:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:1.0:1788839546.560294:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788839546.560312:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788839546.560319:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788839546.560334:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788839546.560339:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788839546.560353:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788839546.560368:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788839546.560382:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788839546.560394:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788839546.561150:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788839546.561168:0:6480:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:1.0:1788839546.561171:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1788839546.561185:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788839546.561192:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788839546.561203:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788839546.561207:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1788839546.561220:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788839546.561225:0:6480:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788839546.561237:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788839546.561250:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788839546.561263:0:6480:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788839546.561266:0:6480:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788839546.561270:0:6480:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788839546.561316:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788839546.561318:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788839546.562045:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788839546.562074:0:9487:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788839546.562088:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788839546.562284:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788839546.562308:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788839546.562323:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788839546.562335:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788839546.562337:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788839546.565137:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788839546.565191:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788839546.565209:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:2.0:1788839546.565474:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:2.0:1788839546.565501:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:2.0:1788839546.565516:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:2.0:1788839546.565527:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788839546.565529:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788839546.566159:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788839546.566186:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788839546.566202:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:2.0:1788839546.566354:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:2.0:1788839546.566376:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:2.0:1788839546.566392:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:2.0:1788839546.566403:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788839546.566405:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788839546.566935:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788839546.567086:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788839546.567106:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788839546.567118:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788839546.567127:0:6480:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788839546.567129:0:6480:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788839546.567427:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788839546.567460:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788839546.567472:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788839546.568447:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788839546.568474:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1788839546.568488:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:2.0:1788839546.568505:0:6480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788839546.568524:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568555:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657289e expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568563:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265728c8 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568571:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572907 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568578:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572923 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568585:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657294d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568592:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572969 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568599:0:6480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572993 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568606:0:6480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568644:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572993 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.568660:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572993 expref: 21 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.568684:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060632704:0@lo:104: 00000100:00100000:2.0:1788839546.569324:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839546.569416:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572969 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.569427:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572969 expref: 21 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.569437:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060632832:0@lo:104: 00000100:00100000:2.0:1788839546.569462:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839546.569568:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657294d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.569576:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657294d expref: 21 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.569583:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060632960:0@lo:104: 00000100:00100000:2.0:1788839546.569603:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.569638:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632704 00000100:00100000:3.0:1788839546.569645:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632704 00000100:00100000:3.0:1788839546.569681:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632832 00000100:00100000:3.0:1788839546.569683:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632832 00000100:00100000:3.0:1788839546.569695:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839546.569702:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6480:x1875734060632704:12345-0@lo:104: 00010000:00010000:3.0:1788839546.569732:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.569814:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839546.569820:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6480:x1875734060632704:12345-0@lo:104: Request processed in 118us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.569827:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839546.569844:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839546.569861:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6480:x1875734060632832:12345-0@lo:104: 00010000:00010000:3.0:1788839546.569870:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.569902:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788839546.569907:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6480:x1875734060632832:12345-0@lo:104: Request processed in 48us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.569913:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788839546.569970:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839546.569977:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.569985:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.569989:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.569997:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.570004:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.570017:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.570052:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570058:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.570076:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570082:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078000/0xad5b343a26572993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657299a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570094:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839546.570096:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570101:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.570104:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570110:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.570115:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.570119:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.570129:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570134:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.570144:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570150:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078e00/0xad5b343a26572969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572970 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.570157:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.570159:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.570160:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.570166:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839546.570321:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572923 expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.570330:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572923 expref: 21 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.570340:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633344:0@lo:104: 00000100:00100000:2.0:1788839546.570380:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839546.570400:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572907 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.570419:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572907 expref: 21 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.570427:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633472:0@lo:104: 00000100:00100000:2.0:1788839546.570450:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839546.570468:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265728c8 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.570475:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265728c8 expref: 21 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.570483:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633600:0@lo:104: 00000100:00100000:2.0:1788839546.570503:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839546.570516:0:6480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657289e expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.570523:0:6480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657289e expref: 21 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.570529:0:6480:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633728:0@lo:104: 00000100:00100000:2.0:1788839546.570545:0:6480:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7444990c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839546.570563:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060632704:0@lo:104: 00000100:00100000:2.0:1788839546.570570:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060632832:0@lo:104: 00000100:00100000:3.0:1788839546.570624:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788839546.570649:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.570660:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060632960 00000100:00100000:3.0:1788839546.570663:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060632960 00000100:00100000:3.0:1788839546.570682:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633344 00000100:00100000:3.0:1788839546.570684:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633344 00000100:00100000:3.0:1788839546.570691:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633472 00000100:00100000:3.0:1788839546.570693:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633472 00000100:00100000:3.0:1788839546.570699:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633600 00000100:00100000:3.0:1788839546.570701:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633600 00000100:00100000:3.0:1788839546.570708:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633728 00000100:00100000:3.0:1788839546.570710:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633728 00000100:00100000:3.0:1788839546.570718:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839546.570723:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+7:6480:x1875734060632960:12345-0@lo:104: 00010000:00010000:3.0:1788839546.570760:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.570823:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839546.570828:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+7:6480:x1875734060632960:12345-0@lo:104: Request processed in 105us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.570834:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839546.570848:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839546.570859:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+6:6480:x1875734060633344:12345-0@lo:104: 00010000:00010000:3.0:1788839546.570866:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.570895:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788839546.570899:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+6:6480:x1875734060633344:12345-0@lo:104: Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.570904:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839546.570916:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839546.570921:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+5:6480:x1875734060633472:12345-0@lo:104: 00010000:00010000:3.0:1788839546.570929:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.570953:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788839546.570958:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+5:6480:x1875734060633472:12345-0@lo:104: Request processed in 38us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.570963:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839546.570976:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839546.570981:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646685050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6480:x1875734060633600:12345-0@lo:104: 00010000:00010000:3.0:1788839546.570988:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.571012:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788839546.571017:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646685050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6480:x1875734060633600:12345-0@lo:104: Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.571022:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839546.571047:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839546.571059:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6480:x1875734060633728:12345-0@lo:104: 00010000:00010000:3.0:1788839546.571066:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.571092:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788839546.571096:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6480:x1875734060633728:12345-0@lo:104: Request processed in 39us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.571102:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788839546.571238:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788839546.571244:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571252:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.571256:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571264:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.571271:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.571278:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.571310:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571316:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.571337:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571356:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031a00/0xad5b343a2657294d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572954 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571369:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788839546.571372:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571378:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740030e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.571381:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571388:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.571394:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.571399:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.571425:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571431:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.571439:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571445:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740030e00/0xad5b343a26572923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657292a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571455:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788839546.571463:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571468:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.571471:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571477:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.571483:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.571487:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.571501:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571506:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.571511:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571517:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26572907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657290e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571527:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839546.571530:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571536:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413ca600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.571539:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571553:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.571559:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.571564:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.571574:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571579:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.571584:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571590:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a265728c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728cf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571599:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839546.571601:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571606:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.571609:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571614:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.571620:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.571629:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.571640:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571645:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.571649:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571655:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a2657289e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728a5 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.571669:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.571670:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.571671:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839546.571685:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060633984:0@lo:103: 00000100:00100000:0.0:1788839546.571716:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.571763:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788839546.571785:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060633856:0@lo:103: 00000100:00100000:0.0:1788839546.571806:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.571821:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060634368:0@lo:103: 00000100:00100000:0.0:1788839546.571836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.571866:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633984 00000100:00100000:0.0:1788839546.571871:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633984 00010000:00010000:0.0:1788839546.571892:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572923 expref: 22 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.571913:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633856 00000100:00100000:0.0:1788839546.571916:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633856 00010000:00010000:0.0:1788839546.571936:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657294d expref: 23 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.571947:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634368 00000100:00100000:0.0:1788839546.571950:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634368 00010000:00010000:0.0:1788839546.571959:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657289e expref: 24 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.571971:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839546.571977:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060633984:12345-0@lo:103: 00010000:00010000:0.0:1788839546.571989:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839546.571994:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572923 expref: 24 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.572004:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572923 expref: 24 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.572020:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839546.572049:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060633984:12345-0@lo:103: Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839546.572055:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839546.572069:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839546.572075:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+23:3617:x1875734060633856:12345-0@lo:103: 00010000:00010000:0.0:1788839546.572082:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839546.572086:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657294d expref: 23 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.572095:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657294d expref: 23 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.572117:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839546.572140:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+23:3617:x1875734060633856:12345-0@lo:103: Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839546.572146:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839546.572160:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839546.572166:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+22:3617:x1875734060634368:12345-0@lo:103: 00010000:00010000:0.0:1788839546.572173:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839546.572178:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657289e expref: 22 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.572186:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657289e expref: 22 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.572196:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839546.572217:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+22:3617:x1875734060634368:12345-0@lo:103: Request processed in 52us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839546.572223:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839546.572260:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060633856:0@lo:103: 00000100:00100000:0.0:1788839546.572269:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060634368:0@lo:103: 00000100:00100000:0.0:1788839546.572276:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060633984:0@lo:103: 00010000:00010000:0.0:1788839546.572298:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839546.572486:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553c00/0xad5b343a26572954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657294d expref: 21 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.572497:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060632960:0@lo:104: 00010000:00010000:2.0:1788839546.572516:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031200/0xad5b343a2657292a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572923 expref: 20 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.572524:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633344:0@lo:104: 00000100:00100000:2.0:1788839546.572533:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633472:0@lo:104: 00000100:00100000:2.0:1788839546.572539:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633600:0@lo:104: 00010000:00010000:2.0:1788839546.572547:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cbc00/0xad5b343a265728a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657289e expref: 19 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.572555:0:6480:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6480:1875734060633728:0@lo:104: 00010000:00010000:2.0:1788839546.572579:0:6480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.572947:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060633216:0@lo:103: 00000100:00100000:2.0:1788839546.572987:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.573020:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060634240:0@lo:103: 00000100:00100000:2.0:1788839546.573041:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.573070:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788839546.573076:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060633088:0@lo:103: 00000100:00100000:2.0:1788839546.573097:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.573110:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060634112:0@lo:103: 00000100:00100000:2.0:1788839546.573141:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.573218:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633216 00000100:00100000:3.0:1788839546.573225:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633216 00010000:00010000:3.0:1788839546.573251:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572969 expref: 19 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.573268:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634240 00000100:00100000:3.0:1788839546.573271:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634240 00010000:00010000:3.0:1788839546.573280:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265728c8 expref: 20 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.573289:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060633088 00000100:00100000:3.0:1788839546.573292:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060633088 00010000:00010000:3.0:1788839546.573300:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572993 expref: 21 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.573309:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634112 00000100:00100000:3.0:1788839546.573312:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634112 00010000:00010000:3.0:1788839546.573322:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572907 expref: 22 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.573334:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839546.573341:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+22:3615:x1875734060633216:12345-0@lo:103: 00010000:00010000:3.0:1788839546.573351:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839546.573363:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572969 expref: 22 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573373:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572969 expref: 22 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573386:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cae00/0xad5b343a26572970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572969 expref: 22 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573397:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839546.573437:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3615:x1875734060633216:12345-0@lo:103: Request processed in 97us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.573443:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839546.573481:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839546.573487:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+20:3615:x1875734060634240:12345-0@lo:103: 00010000:00010000:3.0:1788839546.573494:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839546.573498:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265728c8 expref: 20 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573506:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265728c8 expref: 20 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573514:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740030000/0xad5b343a265728cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265728c8 expref: 20 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573524:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839546.573544:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+19:3615:x1875734060634240:12345-0@lo:103: Request processed in 58us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.573550:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839546.573561:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839546.573574:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+18:3615:x1875734060633088:12345-0@lo:103: 00010000:00010000:3.0:1788839546.573582:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839546.573586:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572993 expref: 18 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573595:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572993 expref: 18 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573604:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078a00/0xad5b343a2657299a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572993 expref: 18 pid: 6479 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573613:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839546.573634:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+17:3615:x1875734060633088:12345-0@lo:103: Request processed in 61us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.573640:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839546.573651:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839546.573656:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+16:3615:x1875734060634112:12345-0@lo:103: 00010000:00010000:3.0:1788839546.573663:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839546.573668:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572907 expref: 16 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573676:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572907 expref: 16 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573685:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782079200/0xad5b343a2657290e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572907 expref: 16 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573695:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573736:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573759:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573767:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573796:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573803:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573808:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413caa00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839546.573812:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573819:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573832:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.573840:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839546.573861:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+15:3615:x1875734060634112:12345-0@lo:103: Request processed in 205us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.573867:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839546.573977:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060633088:0@lo:103: 00000100:00100000:2.0:1788839546.573985:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060634112:0@lo:103: 00000100:00100000:2.0:1788839546.573991:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060633216:0@lo:103: 00000100:00100000:2.0:1788839546.574004:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060634240:0@lo:103: 00010000:00010000:2.0:1788839546.574031:0:6480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.574038:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.574044:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729af lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788839546.574058:0:6480:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788839546.576428:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+14:9481:x1875734060632576:12345-0@lo:253: Request processed in 17546us (20424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.576443:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788839546.576540:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060632576:0@lo:253: 10000000:01000000:3.0:1788839546.576569:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788839546.576572:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839546.576574:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788839546.576575:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839546.576576:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788839546.576577:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839546.576579:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839546.576580:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839546.576582:0:9481:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788839546.576583:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839546.576585:0:9481:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839546.576609:0:9481:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab646536000 from lustre-OST0001 10000000:01000000:3.0:1788839546.576641:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788839546.576645:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788839546.576654:0:9481:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab7486e8000 local copy 10000000:01000000:3.0:1788839546.576657:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839546.576693:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.576704:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.576724:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.576756:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060634496:0@lo:101: 00000100:00100000:3.0:1788839546.577164:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.577240:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839546.577422:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634496 00000100:00100000:2.0:1788839546.577429:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634496 00000100:00100000:2.0:1788839546.577502:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788839546.577512:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+14:9481:x1875734060634496:12345-0@lo:101: 00010000:00010000:2.0:1788839546.577524:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839546.577539:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cb800/0xad5b343a265729bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265729b6 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.577562:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cb800/0xad5b343a265729bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265729b6 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.577573:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cb800/0xad5b343a265729bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729b6 expref: 15 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.577581:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cb800, rc 0) 00000100:00100000:2.0:1788839546.577637:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060634496:12345-0@lo:101: Request processed in 126us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.577643:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788839546.577704:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060634496:0@lo:101: 00010000:00010000:3.0:1788839546.577738:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.577789:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.577887:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060634624:0@lo:501: 00000100:00100000:3.0:1788839546.577913:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.578438:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839546.578506:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634624 00000100:00100000:1.0:1788839546.578512:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634624 00000100:00100000:1.0:1788839546.578541:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788839546.578549:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060634624:12345-0@lo:501: 00000100:00100000:1.0:1788839546.578629:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060634624:12345-0@lo:501: Request processed in 80us (714us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839546.578648:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788839546.578739:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060634624:0@lo:501: 10000000:01000000:3.0:1788839546.578763:0:9481:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788839546.578825:0:9481:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788839546.578832:0:9481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.578841:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.578849:0:9481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.578869:0:9481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788839546.578899:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab646536000 10000000:01000000:3.0:1788839546.578904:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788839546.578909:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788839546.578912:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839546.578916:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788839546.578919:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788839546.578940:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.578958:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.578966:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.578980:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060634752:0@lo:101: 00000100:00100000:3.0:1788839546.579011:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.579023:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839546.579162:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634752 00000100:00100000:1.0:1788839546.579167:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634752 00000100:00100000:1.0:1788839546.579189:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839546.579195:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060634752:12345-0@lo:101: 00010000:00010000:1.0:1788839546.579203:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839546.579213:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265729c4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579230:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265729c4 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579238:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729c4 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579244:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553800, rc 0) 00000100:00100000:1.0:1788839546.579280:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060634752:12345-0@lo:101: Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.579286:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00010000:00010000:1.0:1788839546.579309:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839546.579315:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579323:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839546.579327:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579336:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839546.579353:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839546.579359:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839546.579379:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579385:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839546.579405:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579412:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de6a00/0xad5b343a265729b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xad5b343a265729bd expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579421:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839546.579423:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839546.579425:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839546.579433:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839546.579444:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060634880:0@lo:103: 00000100:00100000:1.0:1788839546.579473:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.579505:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060634880 00000100:00100000:1.0:1788839546.579509:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060634880 00000100:00100000:1.0:1788839546.579537:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839546.579546:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+16:3616:x1875734060634880:12345-0@lo:103: 00010000:00010000:1.0:1788839546.579555:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839546.579568:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cb800/0xad5b343a265729bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a265729b6 expref: 16 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839546.579577:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839546.579611:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+15:3616:x1875734060634880:12345-0@lo:103: Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.579617:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839546.579645:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060634880:0@lo:103: 00000100:00100000:3.0:1788839546.579902:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060634752:0@lo:101: 00010000:00010000:3.0:1788839546.579918:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.579926:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839546.580209:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635008:0@lo:501: 00000100:00100000:1.0:1788839546.580243:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.580277:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839546.580321:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635008 00000100:00100000:2.0:1788839546.580327:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635008 00000100:00100000:2.0:1788839546.580364:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788839546.580372:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635008:12345-0@lo:501: 00000100:00100000:2.0:1788839546.580482:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635008:12345-0@lo:501: Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.580489:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788839546.580559:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635008:0@lo:501: 00000100:00100000:3.0:1788839546.580585:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635136:0@lo:503: 00000100:00100000:3.0:1788839546.580631:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.580652:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839546.580695:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635136 00000100:00100000:1.0:1788839546.580699:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635136 00000100:00100000:1.0:1788839546.580739:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788839546.581995:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635136:12345-0@lo:503: 00000100:00100000:1.0:1788839546.582149:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635136:12345-0@lo:503: Request processed in 1402us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.582157:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788839546.582269:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635136:0@lo:503: 00000040:00080000:3.0:1788839546.582546:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839546.582626:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635264:0@lo:502: 00000100:00100000:3.0:1788839546.582668:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.582698:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839546.583450:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635264 00000100:00100000:2.0:1788839546.583459:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635264 00000100:00100000:2.0:1788839546.583494:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788839546.583502:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635264:12345-0@lo:502: 00000100:00100000:2.0:1788839546.583607:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635264:12345-0@lo:502: Request processed in 105us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.583614:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788839546.584036:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635264:0@lo:502: 00000040:00080000:3.0:1788839546.584264:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788839546.584296:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788839546.584310:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788839546.584325:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788839546.584338:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788839546.584351:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788839546.584381:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635392:0@lo:502: 00000100:00100000:3.0:1788839546.584428:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.584468:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839546.584583:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635392 00000100:00100000:2.0:1788839546.584589:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635392 00000100:00100000:2.0:1788839546.584625:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788839546.584632:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635392:12345-0@lo:502: 00000100:00100000:2.0:1788839546.584738:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635392:12345-0@lo:502: Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.584753:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788839546.585012:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635392:0@lo:502: 00000040:00080000:3.0:1788839546.585059:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788839546.585068:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788839546.585582:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839546.585591:0:9492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788839546.585598:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839546.585601:0:9492:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788839546.585607:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839546.585624:0:9492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab6466919b8) 00000020:00000080:3.0:1788839546.585647:0:9492:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788839546.585653:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788839546.585942:0:9492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab646536000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788839546.585951:0:9492:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788839546.585972:0:9492:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xad5b343a265729d9 00010000:00010000:3.0:1788839546.599786:0:9492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788839546.600105:0:9492:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788839546.603421:0:9492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788839546.603850:0:9492:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788839546.617644:0:9492:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788839546.618012:0:9492:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788839546.625380:0:9492:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788839546.627194:0:9492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788839546.627213:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839546.627221:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839546.627224:0:9492:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788839546.627228:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839546.627232:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839546.627233:0:9492:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839546.627237:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839546.627239:0:9492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839546.627340:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839546.627344:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839546.627346:0:9492:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788839546.627349:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788839546.630554:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788839546.630608:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788839546.630675:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.635502:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.641955:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab646536000 from 1 10000000:01000000:0.0:1788839546.641967:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839546.642022:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.642054:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.642066:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.642093:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635520:0@lo:101: 00000100:00100000:0.0:1788839546.642160:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.642207:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839546.642288:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635520 00000100:00100000:2.0:1788839546.642296:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635520 00000100:00100000:2.0:1788839546.642387:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788839546.642397:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:9481:x1875734060635520:12345-0@lo:101: 00010000:00010000:2.0:1788839546.642411:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839546.642425:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265729e0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.642450:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265729e0 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.642462:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729e0 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.642472:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413caa00, rc 0) 00000100:00100000:2.0:1788839546.642519:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635520:12345-0@lo:101: Request processed in 124us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.642525:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788839546.644019:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635520:0@lo:101: 00010000:00010000:0.0:1788839546.644048:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.644061:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.644197:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635648:0@lo:501: 00000100:00100000:0.0:1788839546.644267:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.651007:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.655227:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635648 00000100:00100000:3.0:1788839546.655252:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635648 00000100:00100000:3.0:1788839546.655313:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788839546.655323:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635648:12345-0@lo:501: 00000100:00100000:3.0:1788839546.655525:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635648:12345-0@lo:501: Request processed in 203us (11256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.655534:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788839546.655654:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635648:0@lo:501: 00000100:00100000:0.0:1788839546.655735:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635776:0@lo:503: 00000100:00100000:0.0:1788839546.655828:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.655862:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.656082:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635776 00000100:00100000:3.0:1788839546.656087:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635776 00000100:00100000:3.0:1788839546.656109:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788839546.656114:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635776:12345-0@lo:503: 00000100:00100000:3.0:1788839546.656196:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635776:12345-0@lo:503: Request processed in 80us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.656202:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788839546.656277:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635776:0@lo:503: 00000040:00080000:0.0:1788839546.656554:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839546.656642:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635904:0@lo:502: 00000100:00100000:0.0:1788839546.656681:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.656732:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.657226:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060635904 00000100:00100000:3.0:1788839546.657233:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060635904 00000100:00100000:3.0:1788839546.657283:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788839546.657289:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635904:12345-0@lo:502: 00000100:00100000:3.0:1788839546.657388:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060635904:12345-0@lo:502: Request processed in 98us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.657395:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788839546.657539:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060635904:0@lo:502: 00000040:00080000:0.0:1788839546.657845:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788839546.657876:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788839546.657906:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636032:0@lo:502: 00000100:00100000:0.0:1788839546.657947:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.657977:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.658142:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636032 00000100:00100000:3.0:1788839546.658148:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636032 00000100:00100000:3.0:1788839546.658172:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788839546.658178:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060636032:12345-0@lo:502: 00000100:00100000:3.0:1788839546.658276:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060636032:12345-0@lo:502: Request processed in 96us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.658282:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788839546.658418:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636032:0@lo:502: 00000040:00080000:0.0:1788839546.658463:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788839546.658471:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788839546.659040:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839546.659051:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839546.659054:0:9496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788839546.659061:0:9496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab646536000 00000020:00000080:0.0:1788839546.659064:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839546.659077:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839546.659079:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839546.659081:0:9496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788839546.659084:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788839546.659203:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788839546.659226:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839546.659254:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659266:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839546.659316:0:9481:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839546.659319:0:9481:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab646536000 10000000:01000000:3.0:1788839546.659322:0:9481:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab646536000 10000000:01000000:3.0:1788839546.659326:0:9481:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839546.659331:0:9481:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab646536000 from 1 10000000:01000000:3.0:1788839546.659333:0:9481:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839546.659362:0:9481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659384:0:9481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659394:0:9481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.659415:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636160:0@lo:101: 00000100:00100000:3.0:1788839546.659463:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.659499:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636160 00000100:00100000:3.0:1788839546.659505:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636160 00000100:00100000:3.0:1788839546.659529:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788839546.659535:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:9481:x1875734060636160:12345-0@lo:101: 00010000:00010000:3.0:1788839546.659545:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839546.659556:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265729ee expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659576:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265729ee expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659587:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729ee expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659595:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6800, rc 0) 00000100:00100000:3.0:1788839546.659621:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636160:12345-0@lo:101: Request processed in 85us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.659627:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788839546.659661:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d43300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.659676:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636160:0@lo:101: 00010000:00010000:3.0:1788839546.659695:0:9481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.659704:0:9481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839546.660020:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636288:0@lo:501: 00000100:00100000:3.0:1788839546.660046:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.660129:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636288 00000100:00100000:3.0:1788839546.660133:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636288 00000100:00100000:3.0:1788839546.660181:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788839546.660189:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636288:12345-0@lo:501: 00000100:00100000:3.0:1788839546.660442:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636288:12345-0@lo:501: Request processed in 253us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.660462:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788839546.660532:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d43300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.660547:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636288:0@lo:501: 00000100:00100000:3.0:1788839546.660592:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636416:0@lo:503: 00000100:00100000:3.0:1788839546.660664:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839546.660687:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636416 00000100:00100000:3.0:1788839546.660691:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636416 00000100:00100000:3.0:1788839546.661024:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788839546.661037:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636416:12345-0@lo:503: 00000100:00100000:3.0:1788839546.661137:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636416:12345-0@lo:503: Request processed in 102us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839546.662234:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d43300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839546.662297:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636416:0@lo:503: 00000040:00080000:0.0:1788839546.662693:0:9481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839546.662808:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636544:0@lo:502: 00000100:00100000:0.0:1788839546.662874:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.662906:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839546.663419:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636544 00000100:00100000:1.0:1788839546.663428:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636544 00000100:00100000:3.0:1788839546.664117:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788839546.665837:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788839546.665863:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636544:12345-0@lo:502: 00000100:00100000:1.0:1788839546.666054:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636544:12345-0@lo:502: Request processed in 203us (3179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.666063:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788839546.668510:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636544:0@lo:502: 00000040:00080000:1.0:1788839546.669576:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788839546.669620:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788839546.669637:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788839546.669652:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788839546.669667:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788839546.669692:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788839546.669708:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788839546.669919:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788839546.669934:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788839546.669947:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788839546.670011:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788839546.670059:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788839546.670159:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788839546.670177:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788839546.670192:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788839546.670208:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788839546.670241:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788839546.670421:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788839546.670439:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788839546.670454:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788839546.670469:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788839546.670483:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788839546.670496:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788839546.670530:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788839546.670560:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788839546.670594:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788839546.670611:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788839546.670628:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788839546.670642:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788839546.670655:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788839546.670669:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788839546.670683:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788839546.670697:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788839546.671593:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788839546.671637:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788839546.671650:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788839546.671665:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:1.0:1788839546.671677:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788839546.671707:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788839546.673620:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788839546.673667:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788839546.673682:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788839546.673697:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788839546.673712:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788839546.673740:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788839546.674083:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788839546.674154:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636672:0@lo:502: 00000100:00100000:0.0:1788839546.674239:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.674299:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d43300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839546.674585:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636672 00000100:00100000:3.0:1788839546.674593:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636672 00000100:00100000:3.0:1788839546.674652:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788839546.674662:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636672:12345-0@lo:502: 00000100:00100000:3.0:1788839546.674839:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060636672:12345-0@lo:502: Request processed in 177us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.674846:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788839546.674897:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060636672:0@lo:502: 00000040:00080000:0.0:1788839546.674957:0:9481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788839546.674967:0:9481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788839546.676110:0:9497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788839546.676126:0:9497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab77e4fb370) 00000020:00000080:0.0:1788839546.676151:0:9497:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788839546.676235:0:9497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab646536000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788839546.676239:0:9497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab646536000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788839546.676241:0:9497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab646536000 3 00010000:00080000:0.0:1788839546.676286:0:9497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6475ab000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788839546.687998:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839546.689429:0:9497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788839546.689639:0:9497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788839546.689703:0:9497:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788839546.695404:0:9497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xad5b343a26572a03 00000100:00080000:1.0:1788839546.695424:0:9497:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839546.695431:0:9497:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ab000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839546.695469:0:9497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777e41c00 x1875734060636800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839546.695532:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060636800:0@lo:38: 00000100:00100000:0.0:1788839546.695605:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788839546.695675:0:9497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788839546.696013:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636800 00000100:00100000:2.0:1788839546.696030:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636800 00000100:00100000:2.0:1788839546.696099:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839546.696106:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060636800:12345-0@lo:38: 00010000:00080000:2.0:1788839546.696143:0:7438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1788839546.696188:0:7438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad5b343a26572a0a 00000004:00100000:2.0:1788839546.696224:0:7438:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839546.696310:0:7438:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839546.697257:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060637056:0@lo:400: 00000100:00100000:1.0:1788839546.697307:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697336:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060637568:0@lo:400: 00000100:00100000:1.0:1788839546.697364:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697387:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788839546.697392:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060636928:0@lo:400: 00000100:00100000:1.0:1788839546.697413:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697431:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060637440:0@lo:400: 00000100:00100000:1.0:1788839546.697451:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697476:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060637184:0@lo:400: 00000100:00100000:1.0:1788839546.697499:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697510:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060637696:0@lo:400: 00000100:00100000:1.0:1788839546.697532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697551:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839546.697557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060637312:0@lo:400: 00000100:00100000:1.0:1788839546.697577:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697605:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060637824:0@lo:400: 00000100:00100000:1.0:1788839546.697626:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.697658:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637056 00000100:00100000:1.0:1788839546.697664:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637056 00000100:00100000:1.0:1788839546.697695:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637312 00000100:00100000:1.0:1788839546.697699:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637312 00000100:00100000:1.0:1788839546.697736:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839546.697745:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060637056:12345-0@lo:400: 00000100:00100000:1.0:1788839546.697816:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060637056:12345-0@lo:400: Request processed in 72us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.697824:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839546.697840:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839546.697869:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060637312:12345-0@lo:400: 00000100:00100000:1.0:1788839546.697923:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060637312:12345-0@lo:400: Request processed in 76us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.697929:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839546.697983:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637568 00000100:00100000:1.0:1788839546.697987:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637568 00000100:00100000:1.0:1788839546.698040:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060636928 00000100:00100000:1.0:1788839546.698044:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060636928 00000100:00100000:1.0:1788839546.698067:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637440 00000100:00100000:1.0:1788839546.698070:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637440 00000100:00100000:1.0:1788839546.698085:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637184 00000100:00100000:1.0:1788839546.698087:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637184 00000100:00100000:1.0:1788839546.698115:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839546.698120:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060637568:12345-0@lo:400: 00000100:00100000:1.0:1788839546.698169:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060637568:12345-0@lo:400: Request processed in 49us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.698176:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839546.698197:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839546.698203:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060636928:12345-0@lo:400: 00000100:00100000:1.0:1788839546.698233:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060636928:12345-0@lo:400: Request processed in 30us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.698238:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788839546.698249:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788839546.698255:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060637440:12345-0@lo:400: 00000100:00100000:1.0:1788839546.698280:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060637440:12345-0@lo:400: Request processed in 26us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.698286:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788839546.698297:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839546.698303:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060637184:12345-0@lo:400: 00000100:00100000:1.0:1788839546.698327:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060637184:12345-0@lo:400: Request processed in 25us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.698333:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839546.698358:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637696 00000100:00100000:1.0:1788839546.698362:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637696 00000100:00100000:1.0:1788839546.698389:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637824 00000100:00100000:1.0:1788839546.698392:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637824 00000100:00100000:1.0:1788839546.698409:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839546.698414:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060637696:12345-0@lo:400: 00000100:00100000:1.0:1788839546.698442:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060637696:12345-0@lo:400: Request processed in 28us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.698448:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839546.698458:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788839546.698464:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060637824:12345-0@lo:400: 00000100:00100000:1.0:1788839546.698489:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060637824:12345-0@lo:400: Request processed in 25us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.698502:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788839546.698551:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060637312:0@lo:400: 00010000:00080000:1.0:1788839546.698565:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e4e00 x1875734060637824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839546.698574:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060637824:0@lo:400: 00010000:00080000:1.0:1788839546.698581:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e42d80 x1875734060637184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839546.698589:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060637184:0@lo:400: 00010000:00080000:1.0:1788839546.698598:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e40380 x1875734060637696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839546.698604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060637696:0@lo:400: 00010000:00080000:1.0:1788839546.698636:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e40000 x1875734060636928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839546.698643:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060636928:0@lo:400: 00010000:00080000:1.0:1788839546.698650:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e41500 x1875734060637440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839546.698657:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060637440:0@lo:400: 00000100:00100000:1.0:1788839546.698665:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060637056:0@lo:400: 00010000:00080000:1.0:1788839546.698673:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e43480 x1875734060637568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839546.698679:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060637568:0@lo:400: 00000100:00100000:2.0:1788839546.701210:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875734060636800:12345-0@lo:38: Request processed in 5092us (5593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.701226:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1788839546.702001:0:9497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788839546.702019:0:9497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ab77e7919b8) 00000020:00000080:1.0:1788839546.702043:0:9497:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788839546.702139:0:9497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab646536000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788839546.702142:0:9497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab646536000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788839546.702145:0:9497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab646536000 3 00010000:00080000:1.0:1788839546.702173:0:9497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab77e6bd800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.152@tcp at head 00000100:00080000:3.0:1788839546.703157:0:9499:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8ab646b4ea00 x1875734060637952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839546.703170:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4b240 going to sleep for 0 seconds 00010000:00010000:1.0:1788839546.708043:0:9497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00010000:00080000:0.0:1788839546.711989:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e41c00 x1875734060636800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839546.712005:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839546.712016:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788839546.712025:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788839546.712031:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788839546.712055:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788839546.712064:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000005583bb36): req@ffff8ab646b4ea00 x1875734060637952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839546.712089:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060636800:0@lo:38: 00000100:00080000:0.0:1788839546.712129:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839546.712136:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839546.712138:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839546.712450:0:9499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.712479:0:9499:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839546.712625:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060637952 00000100:00100000:0.0:1788839546.712633:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060637952 00000100:00100000:0.0:1788839546.712697:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839546.712706:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9499:x1875734060637952:12345-0@lo:901: 00000100:00100000:0.0:1788839546.712846:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9499:x1875734060637952:12345-0@lo:901: Request processed in 140us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839546.712852:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788839546.713018:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788839546.713072:0:9499:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4ea00 x1875734060637952/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788839562 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839546.713083:0:9499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9499:1875734060637952:0@lo:901: 00000020:00000080:1.0:1788839546.717137:0:9497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788839546.717189:0:9497:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788839546.717205:0:9497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xad5b343a26572a18 00000100:00080000:1.0:1788839546.717217:0:9497:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839546.717223:0:9497:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ab77e6bd800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839546.717258:0:9497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6476e4e00 x1875734060638080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839546.717322:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060638080:0@lo:38: 00000100:00100000:0.0:1788839546.717396:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.718415:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638080 00000100:00100000:2.0:1788839546.718424:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638080 00000100:00100000:2.0:1788839546.718466:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839546.718474:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060638080:12345-0@lo:38: 00010000:00080000:2.0:1788839546.718499:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1788839546.718533:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xad5b343a26572a1f 00000004:00100000:2.0:1788839546.718550:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839546.718586:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3b800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788839546.721194:0:9497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788839546.724347:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000100:00100000:2.0:1788839546.728389:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875734060638080:12345-0@lo:38: Request processed in 9905us (10982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839546.728405:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000000:2.0:1788839546.728454:0:9481:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788839546.728493:0:9481:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839546.728561:0:9481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.728573:0:9481:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839546.728633:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839546.728635:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839546.728637:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839546.728638:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839546.728640:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839546.728641:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839546.728642:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839546.728644:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839546.728645:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839546.728647:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839546.728648:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839546.728652:0:9481:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788839546.728654:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839546.728656:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839546.728657:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839546.728658:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839546.728659:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839546.728660:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839546.728661:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839546.728662:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788839546.728664:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788839546.728665:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839546.728666:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839546.728695:0:9481:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788839546.728904:0:9481:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060638208:0@lo:253: 00000100:00100000:2.0:1788839546.728970:0:9481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839546.729004:0:9481:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499240 going to sleep for 11 seconds 00010000:00080000:0.0:1788839546.729186:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e4e00 x1875734060638080/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839546.729197:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839546.729206:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788839546.729213:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788839546.729218:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788839546.729221:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839546.729228:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060638080:0@lo:38: 00000100:00100000:2.0:1788839546.730432:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638208 00000100:00100000:2.0:1788839546.730445:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638208 00000100:00100000:2.0:1788839546.730520:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788839546.730530:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060638208:12345-0@lo:253: 20000000:01000000:2.0:1788839546.730561:0:6481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788839546.730576:0:6481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788839546.736668:0:6481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788839546.736688:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788839546.737033:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839546.737045:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839546.737068:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.737089:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572915 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.737098:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a2657295b expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.737105:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.737141:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a2657295b expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.737156:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a2657295b expref: 17 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.737171:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060638336:0@lo:104: 00000100:00100000:2.0:1788839546.737237:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839546.737323:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572915 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.737332:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572915 expref: 17 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839546.737340:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060638464:0@lo:104: 00000100:00100000:2.0:1788839546.737367:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839546.737762:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+17:9481:x1875734060638208:12345-0@lo:253: Request processed in 7231us (8789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839546.737790:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788839546.737937:0:9481:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:096dcd45-3d06-4359-b81b-4bde04036a06:9481:1875734060638208:0@lo:253: 10000000:01000000:0.0:1788839546.737952:0:9481:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788839546.737956:0:9481:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839546.737958:0:9481:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788839546.737959:0:9481:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839546.737960:0:9481:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839546.737962:0:9481:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839546.737963:0:9481:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839546.737964:0:9481:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788839546.737965:0:9481:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788839546.737967:0:9481:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788839546.737968:0:9481:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839546.737970:0:9481:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788839546.737985:0:9481:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788839546.744124:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aed80 going to sleep for 11 seconds 00080000:10000000:0.0:1788839546.745710:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788839546.745907:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788839546.746130:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788839546.746276:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788839546.746459:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788839546.746676:0:9481:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1788839546.747250:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638336 00000100:00100000:3.0:1788839546.747260:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638336 00000100:00100000:3.0:1788839546.747307:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638464 00000100:00100000:3.0:1788839546.747310:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638464 00000100:00100000:3.0:1788839546.747330:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839546.747339:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060638336:12345-0@lo:104: 00010000:00010000:3.0:1788839546.747356:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.747458:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839546.747465:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:6503:x1875734060638336:12345-0@lo:104: Request processed in 128us (10227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.747471:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839546.747489:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839546.747496:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6503:x1875734060638464:12345-0@lo:104: 00010000:00010000:3.0:1788839546.747505:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839546.747551:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788839546.747557:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:6503:x1875734060638464:12345-0@lo:104: Request processed in 62us (10189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839546.747563:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788839546.747645:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839546.747653:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.747661:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cbe00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.747666:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.747675:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.747681:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.747695:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.748135:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748144:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.748165:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748172:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a2657295b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572962 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748185:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839546.748189:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748195:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cb400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839546.748198:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748204:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839546.748210:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839546.748216:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839546.748228:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748234:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839546.748245:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748252:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657291c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748265:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.748267:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839546.748269:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839546.748286:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060638592:0@lo:103: 00000100:00100000:0.0:1788839546.748329:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.748361:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839546.748367:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060638720:0@lo:103: 00000100:00100000:0.0:1788839546.748404:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839546.748435:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638592 00000100:00100000:0.0:1788839546.748440:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638592 00010000:00010000:0.0:1788839546.748464:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657295b expref: 17 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.748486:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638720 00000100:00100000:0.0:1788839546.748490:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638720 00010000:00010000:0.0:1788839546.748501:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572915 expref: 18 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.748519:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839546.748526:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+18:3614:x1875734060638592:12345-0@lo:103: 00010000:00010000:0.0:1788839546.748538:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839546.748543:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a2657295b expref: 18 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748563:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a2657295b expref: 18 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748580:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839546.748610:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+18:3614:x1875734060638592:12345-0@lo:103: Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839546.748616:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839546.748631:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839546.748637:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+17:3614:x1875734060638720:12345-0@lo:103: 00010000:00010000:0.0:1788839546.748645:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839546.748649:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572915 expref: 17 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748658:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572915 expref: 17 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748670:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748678:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839546.748693:0:6473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.015642370s 00010000:00010000:0.0:1788839546.748697:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.748704:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.749025:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.749039:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.749044:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cbc00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839546.749048:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.749054:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.749063:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.749068:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413ca800/0xad5b343a26572962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a2657295b expref: 17 pid: 6480 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.749071:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839546.749087:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060638336:0@lo:104: 00000100:00100000:0.0:1788839546.749094:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+16:3614:x1875734060638720:12345-0@lo:103: Request processed in 458us (690us total) trans 0 rc 0/0 00010000:00010000:2.0:1788839546.749099:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740030a00/0xad5b343a2657291c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572915 expref: 16 pid: 6481 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.749100:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839546.749110:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875734060638464:0@lo:104: 00000100:00100000:0.0:1788839546.749126:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060638720:0@lo:103: 00010000:00010000:2.0:1788839546.749129:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839546.749133:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060638592:0@lo:103: 00010000:00010000:2.0:1788839546.749138:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.749145:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839546.749150:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cbc00/0xad5b343a26572a26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839546.750690:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788839546.758087:0:9481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788839546.768484:0:9481:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788839546.768496:0:9481:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788839546.768532:0:9481:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788839546.768584:0:9481:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788839546.768606:0:9481:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788839546.768644:0:9481:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788839546.771595:0:9481:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839546.772568:0:9481:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:2.0:1788839547.689175:0:9554:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839547.689449:0:9554:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788839547.710914:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839547.776007:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060638848:0@lo:13: 00000100:00100000:1.0:1788839547.776082:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839547.776152:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839547.776159:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060638976:0@lo:13: 00000100:00100000:1.0:1788839547.776182:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839547.777855:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638848 00000100:00100000:0.0:1788839547.777868:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638848 00000100:00100000:0.0:1788839547.777911:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060638976 00000100:00100000:0.0:1788839547.777914:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060638976 00000100:00100000:0.0:1788839547.777932:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839547.777942:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060638848:12345-0@lo:13: 00002000:00000024:0.0:1788839547.777983:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839547.778070:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060638848:12345-0@lo:13: Request processed in 128us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839547.778077:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839547.778095:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839547.778102:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060638976:12345-0@lo:13: 00002000:00000024:0.0:1788839547.778111:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839547.778135:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060638976:12345-0@lo:13: Request processed in 34us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839547.778140:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788839547.779554:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5e680 x1875734060638976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839547.779593:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060638976:0@lo:13: 00010000:00080000:1.0:1788839547.779609:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5bb80 x1875734060638848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839563 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839547.779620:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060638848:0@lo:13: 00000100:00100000:3.0:1788839548.290609:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060639104:0@lo:41: 00000100:00100000:3.0:1788839548.290685:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839548.290808:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639104 00000100:00100000:3.0:1788839548.290816:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639104 00000100:00100000:3.0:1788839548.290865:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839548.290873:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060639104:12345-0@lo:41: 00000004:00000024:3.0:1788839548.290908:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788839548.290953:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060639104:12345-0@lo:41: Request processed in 80us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839548.290960:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839548.291007:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060639104:0@lo:41: 00010000:00010000:0.0:1788839548.734913:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839549.758972:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839550.335228:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839550.335254:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060639232:0@lo:41: 00000100:00100000:1.0:1788839550.335331:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839550.335404:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639232 00000100:00100000:1.0:1788839550.335411:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639232 00000100:00100000:1.0:1788839550.335461:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839550.335469:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060639232:12345-0@lo:41: 00000004:00000024:1.0:1788839550.335503:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788839550.335550:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060639232:12345-0@lo:41: Request processed in 80us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839550.335557:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839550.335604:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060639232:0@lo:41: 00010000:00010000:0.0:1788839550.783038:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839551.806996:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839551.871495:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060639488:0@lo:400: 00000100:00100000:1.0:1788839551.871667:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060639360:0@lo:400: 00000100:00100000:1.0:1788839551.871736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.871896:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.871927:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060639616:0@lo:400: 00000100:00100000:0.0:1788839551.871960:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.871987:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060639744:0@lo:400: 00000100:00100000:0.0:1788839551.872025:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.872060:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639488 00000100:00100000:2.0:1788839551.872061:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639744 00000100:00100000:2.0:1788839551.872068:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639744 00000100:00100000:0.0:1788839551.872068:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639488 00000100:00100000:1.0:1788839551.872137:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060639872:0@lo:400: 00000100:00100000:1.0:1788839551.872161:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839551.872177:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060640384:0@lo:400: 00000100:00100000:1.0:1788839551.872194:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839551.872225:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639360 00000100:00100000:1.0:1788839551.872228:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639360 00000100:00100000:1.0:1788839551.872270:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788839551.872289:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:3616:x1875734060639360:12345-0@lo:400: 00000100:00100000:1.0:1788839551.872340:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+15:3616:x1875734060639360:12345-0@lo:400: Request processed in 52us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839551.872347:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788839551.872376:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639616 00000100:00100000:1.0:1788839551.872380:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639616 00000100:00100000:1.0:1788839551.872396:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060639872 00000100:00100000:1.0:1788839551.872398:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060639872 00000100:00100000:1.0:1788839551.872411:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839551.872417:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060639616:12345-0@lo:400: 00000100:00100000:1.0:1788839551.872453:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060639616:12345-0@lo:400: Request processed in 36us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839551.872459:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839551.872470:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839551.872475:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060639872:12345-0@lo:400: 00000100:00100000:1.0:1788839551.872500:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060639872:12345-0@lo:400: Request processed in 25us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839551.872505:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839551.872522:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640384 00000100:00100000:1.0:1788839551.872525:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640384 00000100:00100000:2.0:1788839551.872544:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839551.872559:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060639744:12345-0@lo:400: 00000100:00100000:2.0:1788839551.872605:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060639744:12345-0@lo:400: Request processed in 47us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839551.872611:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839551.872761:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839551.872788:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060640384:12345-0@lo:400: 00000100:00100000:0.0:1788839551.872901:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788839551.872909:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060639488:12345-0@lo:400: 00000100:00100000:0.0:1788839551.872941:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060639488:12345-0@lo:400: Request processed in 34us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839551.872955:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788839551.873064:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060640384:12345-0@lo:400: Request processed in 296us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839551.873070:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788839551.873087:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839551.873116:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060639360:0@lo:400: 00000100:00100000:1.0:1788839551.873128:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060639872:0@lo:400: 00010000:00080000:1.0:1788839551.873139:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5ad80 x1875734060640384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839551.873149:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060640384:0@lo:400: 00000100:00100000:0.0:1788839551.873223:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060639616:0@lo:400: 00000100:00100000:0.0:1788839551.873233:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060640128:0@lo:400: 00000100:00100000:0.0:1788839551.873262:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.873354:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060640640:0@lo:400: 00000100:00100000:0.0:1788839551.873378:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788839551.873475:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58000 x1875734060639744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839551.873485:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060639744:0@lo:400: 00000100:00100000:0.0:1788839551.873492:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060640256:0@lo:400: 00000100:00100000:0.0:1788839551.873514:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.873557:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640256 00000100:00100000:0.0:1788839551.873562:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640256 00000100:00100000:0.0:1788839551.873595:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839551.873601:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060640256:12345-0@lo:400: 00000100:00100000:0.0:1788839551.873635:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060640256:12345-0@lo:400: Request processed in 35us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839551.873642:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788839551.873660:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788839551.873675:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5bb80 x1875734060640256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839551.873684:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060640256:0@lo:400: 00010000:00080000:0.0:1788839551.873721:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b59c00 x1875734060639488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839551.873743:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060639488:0@lo:400: 00000100:00100000:0.0:1788839551.873749:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060640000:0@lo:400: 00000100:00100000:0.0:1788839551.873869:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839551.876616:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060640512:0@lo:400: 00000100:00100000:0.0:1788839551.876681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839551.876713:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640128 00000100:00100000:1.0:1788839551.876722:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640128 00000100:00100000:1.0:1788839551.876872:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640640 00000100:00100000:2.0:1788839551.876905:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640000 00000100:00100000:2.0:1788839551.876910:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640000 00000100:00100000:1.0:1788839551.876937:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640640 00000100:00100000:2.0:1788839551.876938:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839551.876950:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060640128:12345-0@lo:400: 00000100:00100000:1.0:1788839551.876968:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788839551.876977:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060640000:12345-0@lo:400: 00000100:00100000:2.0:1788839551.877021:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060640128:12345-0@lo:400: Request processed in 74us (3757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839551.877028:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060640000:12345-0@lo:400: Request processed in 51us (3229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839551.877033:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839551.877040:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788839551.877057:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788839551.877065:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060640640:12345-0@lo:400: 00000100:00100000:2.0:1788839551.877165:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060640640:12345-0@lo:400: Request processed in 101us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839551.877172:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788839551.877221:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58380 x1875734060640128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839551.877235:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060640128:0@lo:400: 00010000:00080000:2.0:1788839551.877255:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58700 x1875734060640640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839551.877267:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060640640:0@lo:400: 00010000:00080000:0.0:1788839551.877267:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5b100 x1875734060640000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839551.877359:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060640000:0@lo:400: 00000100:00080000:0.0:1788839551.877380:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839551.877385:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839551.877395:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640512 00000100:00100000:0.0:1788839551.877398:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640512 00000100:00100000:0.0:1788839551.877437:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839551.877444:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060640512:12345-0@lo:400: 00000100:00100000:0.0:1788839551.877479:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060640512:12345-0@lo:400: Request processed in 37us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839551.877485:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788839551.877509:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58a80 x1875734060640512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839551.877518:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060640512:0@lo:400: 00000100:00080000:2.0:1788839551.877796:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788839552.838105:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788839552.895103:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788839552.895114:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab777b41000 from 39 10000000:01000000:3.0:1788839552.895119:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839552.895168:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.895180:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.895190:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839552.895226:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060640768:0@lo:101: 00000100:00100000:3.0:1788839552.895294:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.895341:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.895389:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640768 00000100:00100000:3.0:1788839552.895396:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640768 00000100:00100000:3.0:1788839552.895438:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788839552.895446:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060640768:12345-0@lo:101: 00010000:00010000:3.0:1788839552.895459:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839552.895472:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a2d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.895494:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a2d expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.895505:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a2d expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.895514:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7800, rc 0) 00000100:00100000:3.0:1788839552.895551:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060640768:12345-0@lo:101: Request processed in 105us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.895557:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788839552.895604:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060640768:0@lo:101: 00010000:00010000:3.0:1788839552.895618:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.895627:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839552.899474:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060640896:0@lo:13: 00000100:00100000:0.0:1788839552.899549:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.899603:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060640896 00000100:00100000:0.0:1788839552.899610:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060640896 00000100:00100000:0.0:1788839552.899670:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839552.899679:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060640896:12345-0@lo:13: 00002000:00000024:0.0:1788839552.899720:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839552.899765:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060640896:12345-0@lo:13: Request processed in 87us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.899796:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788839552.899905:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58a80 x1875734060640896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839552.899991:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060640896:0@lo:13: 00000100:00100000:3.0:1788839552.902871:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641152:0@lo:501: 00000100:00100000:3.0:1788839552.902952:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.903002:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.903423:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641152 00000100:00100000:0.0:1788839552.903430:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641152 00000100:00100000:0.0:1788839552.903475:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788839552.903484:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060641152:12345-0@lo:501: 00000100:00100000:0.0:1788839552.903625:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060641152:12345-0@lo:501: Request processed in 142us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.903633:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788839552.903677:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641152:0@lo:501: 00000100:00100000:0.0:1788839552.903728:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641280:0@lo:503: 00000100:00100000:0.0:1788839552.903768:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.903796:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.903809:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641280 00000100:00100000:0.0:1788839552.903812:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641280 00000100:00100000:0.0:1788839552.908321:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788839552.908347:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060641280:12345-0@lo:503: 00000100:00100000:0.0:1788839552.908525:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060641280:12345-0@lo:503: Request processed in 191us (4756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.908545:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788839552.908719:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641280:0@lo:503: 00000100:00100000:3.0:1788839552.909582:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9806:1875734060641408:0@lo:502: 00000100:00100000:3.0:1788839552.909638:0:9806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.909680:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.909897:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060641024:0@lo:13: 00000100:00100000:2.0:1788839552.909998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.910240:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641408 00000100:00100000:0.0:1788839552.910247:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641408 00000100:00100000:0.0:1788839552.910292:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788839552.910302:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:9806:x1875734060641408:12345-0@lo:502: 00000100:00100000:0.0:1788839552.910413:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:9806:x1875734060641408:12345-0@lo:502: Request processed in 113us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.910420:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788839552.910495:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641024 00000100:00100000:3.0:1788839552.910499:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641024 00000100:00100000:3.0:1788839552.910535:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839552.910542:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060641024:12345-0@lo:13: 00002000:00000024:3.0:1788839552.910558:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839552.910594:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060641024:12345-0@lo:13: Request processed in 52us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.910600:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839552.910631:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9806:1875734060641408:0@lo:502: 00000100:00100000:3.0:1788839552.910693:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9806:1875734060641536:0@lo:502: 00000100:00100000:3.0:1788839552.910727:0:9806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.910748:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641536 00000100:00100000:3.0:1788839552.910752:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641536 00000100:00100000:3.0:1788839552.910806:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788839552.910814:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:9806:x1875734060641536:12345-0@lo:502: 00010000:00080000:2.0:1788839552.911019:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5ea00 x1875734060641024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839552.911039:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060641024:0@lo:13: 00000100:00100000:3.0:1788839552.911251:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:9806:x1875734060641536:12345-0@lo:502: Request processed in 438us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.911258:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788839552.911312:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.911324:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9806:1875734060641536:0@lo:502: 00000040:00080000:3.0:1788839552.911344:0:9806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788839552.911541:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788839552.911566:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839552.911576:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.911587:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.911598:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788839552.911601:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788839552.911605:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788839552.911631:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.911639:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.911647:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.911659:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641664:0@lo:101: 00000100:00100000:2.0:1788839552.911700:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.911725:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.911762:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641664 00000100:00100000:0.0:1788839552.911793:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641664 00000100:00100000:0.0:1788839552.911821:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788839552.911827:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060641664:12345-0@lo:101: 00010000:00010000:0.0:1788839552.911896:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839552.911908:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a3b expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.911985:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a3b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.911995:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a3b expref: 17 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.912003:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740031200, rc 0) 00000100:00100000:0.0:1788839552.912035:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060641664:12345-0@lo:101: Request processed in 207us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.912040:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788839552.912268:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641664:0@lo:101: 00010000:00010000:2.0:1788839552.912282:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.912302:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.912352:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641792:0@lo:501: 00000100:00100000:2.0:1788839552.912378:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.912407:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.912447:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641792 00000100:00100000:3.0:1788839552.912451:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641792 00000100:00100000:3.0:1788839552.912546:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788839552.912554:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060641792:12345-0@lo:501: 00000100:00100000:3.0:1788839552.912663:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060641792:12345-0@lo:501: Request processed in 111us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.912669:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788839552.912725:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641792:0@lo:501: 00000100:00100000:0.0:1788839552.912748:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641920:0@lo:503: 00000100:00100000:0.0:1788839552.912830:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.917419:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.917469:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060641920 00000100:00100000:2.0:1788839552.917479:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060641920 00000100:00100000:2.0:1788839552.917536:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788839552.917547:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060641920:12345-0@lo:503: 00000100:00100000:2.0:1788839552.917715:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060641920:12345-0@lo:503: Request processed in 170us (4883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.917722:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788839552.917805:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060641920:0@lo:503: 00000100:00100000:2.0:1788839552.918187:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9807:1875734060642048:0@lo:502: 00000100:00100000:2.0:1788839552.918230:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.918253:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642048 00000100:00100000:2.0:1788839552.918256:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642048 00000100:00100000:2.0:1788839552.918277:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788839552.918283:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9807:x1875734060642048:12345-0@lo:502: 00000100:00100000:2.0:1788839552.918357:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9807:x1875734060642048:12345-0@lo:502: Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.918364:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788839552.918397:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.918411:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9807:1875734060642048:0@lo:502: 00000020:01000000:2.0:1788839552.918439:0:9807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839552.918448:0:9807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839552.918451:0:9807:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839552.918454:0:9807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839552.918456:0:9807:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788839552.918470:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9807:1875734060642176:0@lo:502: 00000100:00100000:2.0:1788839552.918503:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.918526:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642176 00000100:00100000:2.0:1788839552.918530:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642176 00000100:00100000:2.0:1788839552.918547:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788839552.918553:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9807:x1875734060642176:12345-0@lo:502: 00000100:00100000:2.0:1788839552.918607:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:9807:x1875734060642176:12345-0@lo:502: Request processed in 53us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.918613:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788839552.918639:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.918650:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9807:1875734060642176:0@lo:502: 00000020:01000000:2.0:1788839552.918668:0:9807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839552.918672:0:9807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839552.918674:0:9807:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788839552.918677:0:9807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788839552.918739:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788839552.918756:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788839552.918766:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.918794:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.918803:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839552.918811:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab74434b000 from 39 10000000:01000000:2.0:1788839552.918814:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839552.918837:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.918844:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.918853:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.918864:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642304:0@lo:101: 00000100:00100000:2.0:1788839552.918885:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.918897:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.918907:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642304 00000100:00100000:2.0:1788839552.918909:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642304 00000100:00100000:2.0:1788839552.919019:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788839552.919025:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060642304:12345-0@lo:101: 00010000:00010000:2.0:1788839552.919033:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839552.919043:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a49 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.919062:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a49 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.919070:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a49 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.919078:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cb800, rc 0) 00000100:00100000:2.0:1788839552.919103:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060642304:12345-0@lo:101: Request processed in 79us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.919114:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788839552.919140:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642304:0@lo:101: 00010000:00010000:2.0:1788839552.919151:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.919159:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.919196:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642432:0@lo:501: 00000100:00100000:2.0:1788839552.919217:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.919229:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.919238:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642432 00000100:00100000:2.0:1788839552.919241:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642432 00000100:00100000:2.0:1788839552.919255:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788839552.919259:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060642432:12345-0@lo:501: 00000100:00100000:2.0:1788839552.919347:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060642432:12345-0@lo:501: Request processed in 86us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.919353:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788839552.919377:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642432:0@lo:501: 00000100:00100000:2.0:1788839552.919396:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642560:0@lo:503: 00000100:00100000:2.0:1788839552.919426:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.919446:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.919455:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642560 00000100:00100000:2.0:1788839552.919458:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642560 00000100:00100000:2.0:1788839552.919474:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839552.919479:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060642560:12345-0@lo:503: 00000100:00100000:2.0:1788839552.919549:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060642560:12345-0@lo:503: Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.919555:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839552.919593:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642560:0@lo:503: 00000100:00100000:3.0:1788839552.920436:0:9808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9808:1875734060642688:0@lo:502: 00000100:00100000:3.0:1788839552.920485:0:9808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.920510:0:9808:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.920556:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642688 00000100:00100000:2.0:1788839552.920562:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642688 00000100:00100000:2.0:1788839552.920598:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839552.920605:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:9808:x1875734060642688:12345-0@lo:502: 00000100:00100000:2.0:1788839552.920704:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:9808:x1875734060642688:12345-0@lo:502: Request processed in 100us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.920711:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788839552.921030:0:9808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9808:1875734060642688:0@lo:502: 00000100:00100000:3.0:1788839552.921077:0:9808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9808:1875734060642816:0@lo:502: 00000100:00100000:3.0:1788839552.921109:0:9808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.921137:0:9808:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.921173:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642816 00000100:00100000:2.0:1788839552.921177:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642816 00000100:00100000:2.0:1788839552.921204:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788839552.921211:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:9808:x1875734060642816:12345-0@lo:502: 00000100:00100000:2.0:1788839552.921269:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:9808:x1875734060642816:12345-0@lo:502: Request processed in 58us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.921275:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788839552.921714:0:9808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9808:1875734060642816:0@lo:502: 00000040:00080000:3.0:1788839552.921737:0:9808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788839552.922028:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788839552.922049:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839552.922059:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.922068:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.922077:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839552.922086:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab74434b000 from 6 10000000:01000000:2.0:1788839552.922089:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839552.922114:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.922122:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.922130:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.922142:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642944:0@lo:101: 00000100:00100000:2.0:1788839552.922174:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.922234:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.922691:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060642944 00000100:00100000:3.0:1788839552.922698:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060642944 00000100:00100000:3.0:1788839552.922739:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788839552.922746:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060642944:12345-0@lo:101: 00010000:00010000:3.0:1788839552.922757:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839552.922817:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de7600/0xad5b343a26572a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a57 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.922850:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de7600/0xad5b343a26572a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a57 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.922860:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de7600/0xad5b343a26572a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a57 expref: 19 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.922868:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7600, rc 0) 00000100:00100000:3.0:1788839552.922910:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060642944:12345-0@lo:101: Request processed in 165us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.922917:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788839552.923314:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060642944:0@lo:101: 00010000:00010000:2.0:1788839552.923330:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.923339:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.923397:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643072:0@lo:256: 00000100:00100000:2.0:1788839552.923437:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.923501:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.923580:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643072 00000100:00100000:0.0:1788839552.923586:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643072 00000100:00100000:0.0:1788839552.923651:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788839552.923661:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060643072:12345-0@lo:256: 20000000:01000000:0.0:1788839552.923677:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839552.923705:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839552.923708:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788839552.923815:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060643072:12345-0@lo:256: Request processed in 156us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.923822:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788839552.923886:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643072:0@lo:256: 10000000:01000000:2.0:1788839552.923943:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788839552.923951:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.923969:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.923978:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788839552.923980:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788839552.923983:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788839552.924004:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.924011:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.924020:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.924031:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643200:0@lo:101: 00000100:00100000:2.0:1788839552.924054:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.924237:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.924266:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643200 00000100:00100000:3.0:1788839552.924271:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643200 00000100:00100000:3.0:1788839552.924298:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788839552.924306:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060643200:12345-0@lo:101: 00010000:00010000:3.0:1788839552.924314:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839552.924325:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a65 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.924342:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a65 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.924351:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a65 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.924359:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6600, rc 0) 00000100:00100000:3.0:1788839552.924426:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060643200:12345-0@lo:101: Request processed in 121us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.924432:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788839552.924530:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643200:0@lo:101: 00010000:00010000:2.0:1788839552.924542:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.924550:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.924602:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643328:0@lo:501: 00000100:00100000:2.0:1788839552.924625:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.924679:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.924717:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643328 00000100:00100000:3.0:1788839552.924722:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643328 00000100:00100000:3.0:1788839552.925245:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788839552.925254:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060643328:12345-0@lo:501: 00000100:00100000:3.0:1788839552.925372:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060643328:12345-0@lo:501: Request processed in 119us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.925379:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788839552.925751:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643328:0@lo:501: 00000100:00100000:3.0:1788839552.926109:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643456:0@lo:503: 00000100:00100000:3.0:1788839552.926221:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.926251:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.926293:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643456 00000100:00100000:0.0:1788839552.926298:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643456 00000100:00100000:0.0:1788839552.926333:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788839552.926340:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060643456:12345-0@lo:503: 00000100:00100000:0.0:1788839552.926463:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060643456:12345-0@lo:503: Request processed in 121us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.926469:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788839552.926609:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643456:0@lo:503: 00000100:00100000:3.0:1788839552.927074:0:9809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9809:1875734060643584:0@lo:502: 00000100:00100000:3.0:1788839552.927110:0:9809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.927138:0:9809:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.927213:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643584 00000100:00100000:0.0:1788839552.927218:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643584 00000100:00100000:0.0:1788839552.927248:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788839552.927254:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:9809:x1875734060643584:12345-0@lo:502: 00000100:00100000:0.0:1788839552.927329:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:9809:x1875734060643584:12345-0@lo:502: Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.927344:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788839552.927414:0:9809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9809:1875734060643584:0@lo:502: 00000020:01000000:3.0:1788839552.927435:0:9809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839552.927442:0:9809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788839552.927450:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839552.927452:0:9809:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788839552.927456:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839552.927460:0:9809:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788839552.927483:0:9809:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788839552.927486:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839552.927512:0:9809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ab6479a0000) 00000020:00000080:3.0:1788839552.927536:0:9809:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:3.0:1788839552.927547:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788839552.927621:0:9809:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788839552.927627:0:9809:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788839552.927634:0:9809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26572a7a 00010000:00080000:3.0:1788839552.927672:0:9809:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab78193f800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839552.928033:0:9809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:3.0:1788839552.928162:0:9809:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788839552.928173:0:9809:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788839552.928340:0:9809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839552.928449:0:9809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839552.928605:0:9809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788839552.928799:0:9809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788839552.929226:0:9810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839552.929231:0:9810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788839552.929804:0:9809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788839552.929814:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788839552.929849:0:9809:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788839552.929871:0:9809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26572a81 00000100:00080000:0.0:1788839552.929879:0:9809:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788839552.929884:0:9809:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab78193f800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839552.929913:0:9809:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b59c00 x1875734060643712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839552.929995:0:9809:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788839552.930049:0:9809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839552.930053:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839552.930055:0:9809:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788839552.930057:0:9809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839552.930060:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839552.930061:0:9809:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788839552.930064:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788839552.930065:0:9809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788839552.930089:0:9809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9809:1875734060643840:0@lo:502: 00000100:00100000:0.0:1788839552.930154:0:9809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.930186:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643840 00000100:00100000:0.0:1788839552.930191:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643840 00000100:00100000:0.0:1788839552.930227:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788839552.930236:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+20:9809:x1875734060643840:12345-0@lo:502: 00000100:00100000:0.0:1788839552.930324:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+20:9809:x1875734060643840:12345-0@lo:502: Request processed in 89us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.930331:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788839552.930379:0:9809:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.930405:0:9809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9809:1875734060643840:0@lo:502: 00000020:01000000:0.0:1788839552.930429:0:9809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839552.930432:0:9809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839552.930434:0:9809:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788839552.930437:0:9809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788839552.930483:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788839552.930507:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788839552.930517:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.930529:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839552.930540:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788839552.930542:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab745341000 from 39 10000000:01000000:0.0:1788839552.930546:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788839552.930568:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.930576:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.930584:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839552.930596:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643968:0@lo:101: 00000100:00100000:0.0:1788839552.930620:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.930635:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.930646:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643968 00000100:00100000:0.0:1788839552.930650:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643968 00000100:00100000:0.0:1788839552.930680:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788839552.930808:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060643712:0@lo:8: 00000100:00100000:3.0:1788839552.930842:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.931133:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060643712 00000100:00100000:2.0:1788839552.931137:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060643712 00000100:00100000:2.0:1788839552.931161:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839552.931167:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3613:x1875734060643712:12345-0@lo:8: 00010000:00080000:2.0:1788839552.931191:0:8539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:2.0:1788839552.931217:0:8539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26572a8f 00002000:00100000:2.0:1788839552.931231:0:8539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ab646b3e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788839552.931236:0:8539:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788839552.931239:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788839552.931300:0:8539:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788839552.931539:0:8539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788839552.931564:0:8539:0:(import.c:65:import_set_state_nolock()) ffff8ab646b38000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839552.931617:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060643712:12345-0@lo:8: Request processed in 448us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.931624:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839552.931646:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060644480:0@lo:400: 00000100:00100000:2.0:1788839552.931673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.931790:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060644096:0@lo:400: 00000100:00100000:3.0:1788839552.931820:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.931841:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060644608:0@lo:400: 00000100:00100000:3.0:1788839552.931861:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.931992:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060643968:12345-0@lo:101: 00010000:00010000:0.0:1788839552.932002:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839552.932017:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a88 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.932038:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a88 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.932047:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a88 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.932055:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740030a00, rc 0) 00000100:00100000:0.0:1788839552.932083:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060643968:12345-0@lo:101: Request processed in 96us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.932089:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788839552.932119:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644096 00000100:00100000:0.0:1788839552.932124:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644096 00000100:00100000:0.0:1788839552.932227:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644608 00000100:00100000:0.0:1788839552.932231:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644608 00000100:00100000:2.0:1788839552.932291:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060644992:0@lo:400: 00000100:00100000:2.0:1788839552.932316:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.932398:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060644224:0@lo:400: 00000100:00100000:2.0:1788839552.932421:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.932438:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060644736:0@lo:400: 00000100:00100000:2.0:1788839552.932458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.932473:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644992 00000100:00100000:3.0:1788839552.932476:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644992 00000100:00100000:3.0:1788839552.932500:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839552.932506:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060644096:12345-0@lo:400: 00000100:00100000:3.0:1788839552.932545:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060644096:12345-0@lo:400: Request processed in 38us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.932551:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839552.932564:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839552.932570:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060644608:12345-0@lo:400: 00000100:00100000:3.0:1788839552.932608:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060644608:12345-0@lo:400: Request processed in 39us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.932615:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839552.932628:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788839552.932634:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060644992:12345-0@lo:400: 00000100:00100000:3.0:1788839552.932664:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060644992:12345-0@lo:400: Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.932669:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788839552.932712:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5e300 x1875734060644096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839552.932725:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060644096:0@lo:400: 00010000:00080000:3.0:1788839552.932734:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5c380 x1875734060644608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839552.932742:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060644608:0@lo:400: 00000100:00100000:3.0:1788839552.932809:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644480 00000100:00100000:3.0:1788839552.932813:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644480 00000100:00100000:3.0:1788839552.932829:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644224 00000100:00100000:3.0:1788839552.932832:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644224 00000100:00100000:3.0:1788839552.932842:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788839552.932847:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060644480:12345-0@lo:400: 00000100:00100000:3.0:1788839552.932875:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060644480:12345-0@lo:400: Request processed in 27us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.932880:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788839552.932889:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788839552.932894:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060644224:12345-0@lo:400: 00000100:00100000:0.0:1788839552.933024:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060643968:0@lo:101: 00010000:00010000:0.0:1788839552.933042:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.933052:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839552.933109:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060645120:0@lo:501: 00000100:00100000:0.0:1788839552.933205:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.933227:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.933242:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645120 00000100:00100000:0.0:1788839552.933246:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645120 00000100:00100000:0.0:1788839552.933270:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788839552.933275:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060645120:12345-0@lo:501: 00000100:00100000:0.0:1788839552.933382:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060645120:12345-0@lo:501: Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.933389:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788839552.933417:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060645120:0@lo:501: 00000100:00100000:0.0:1788839552.933438:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060645248:0@lo:503: 00000100:00100000:0.0:1788839552.933474:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.933494:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.933504:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645248 00000100:00100000:0.0:1788839552.933507:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645248 00000100:00100000:0.0:1788839552.933528:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788839552.933534:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060645248:12345-0@lo:503: 00000100:00100000:0.0:1788839552.933607:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060645248:12345-0@lo:503: Request processed in 73us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.933613:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788839552.933656:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060645248:0@lo:503: 00000100:00100000:3.0:1788839552.934030:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060644224:12345-0@lo:400: Request processed in 1134us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.934037:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788839552.934061:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060644352:0@lo:400: 00000100:00100000:3.0:1788839552.934087:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.934114:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060644864:0@lo:400: 00000100:00100000:3.0:1788839552.934154:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788839552.934206:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b59c00 x1875734060643712/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839552.934216:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839552.934223:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788839552.934231:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788839552.934237:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788839552.934240:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788839552.934253:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788839552.934259:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060643712:0@lo:8: 00000004:00080000:3.0:1788839552.934281:0:9810:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788839552.934350:0:9810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 207878578823ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788839552.934356:0:9810:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788839552.934408:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060645376:0@lo:700: 00000100:00100000:3.0:1788839552.934437:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.934452:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742b57240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.935043:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060644224:0@lo:400: 00000100:00100000:2.0:1788839552.935071:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644736 00000100:00100000:2.0:1788839552.935082:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644736 00000100:00100000:2.0:1788839552.935107:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644352 00000100:00100000:2.0:1788839552.935109:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644352 00000100:00100000:2.0:1788839552.935119:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060644864 00000100:00100000:2.0:1788839552.935121:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060644864 00000100:00100000:2.0:1788839552.935133:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839552.935141:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060644736:12345-0@lo:400: 00000100:00100000:2.0:1788839552.935191:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060644736:12345-0@lo:400: Request processed in 52us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.935198:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839552.935210:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839552.935216:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060644352:12345-0@lo:400: 00000100:00100000:2.0:1788839552.935242:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060644352:12345-0@lo:400: Request processed in 27us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.935247:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839552.935256:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839552.935261:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060644864:12345-0@lo:400: 00000100:00100000:2.0:1788839552.935280:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060644864:12345-0@lo:400: Request processed in 20us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.935285:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839552.935317:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060644480:0@lo:400: 00010000:00080000:2.0:1788839552.935330:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5ca80 x1875734060644992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839552.935340:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060644992:0@lo:400: 00010000:00080000:2.0:1788839552.935363:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5ed80 x1875734060644736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839552.935383:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060644736:0@lo:400: 00010000:00080000:2.0:1788839552.935404:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5d180 x1875734060644352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839552.935413:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060644352:0@lo:400: 00010000:00080000:2.0:1788839552.935422:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5c700 x1875734060644864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839552.935430:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060644864:0@lo:400: 00000100:00100000:0.0:1788839552.935505:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645376 00000100:00100000:0.0:1788839552.935510:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645376 00000100:00100000:0.0:1788839552.935552:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839552.935558:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9811:x1875734060645376:12345-0@lo:700: 00000100:00100000:0.0:1788839552.935590:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8412:1875734060645504:0@lo:700: 00000100:00100000:0.0:1788839552.935616:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.935638:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.935651:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645504 00000100:00100000:0.0:1788839552.935654:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645504 00000100:00100000:0.0:1788839552.935674:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839552.935680:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8412:x1875734060645504:12345-0@lo:700: 00000100:00080000:2.0:1788839552.936545:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839552.936878:0:9812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9812:1875734060645632:0@lo:502: 00000100:00100000:0.0:1788839552.936994:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.937026:0:9812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.937084:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645632 00000100:00100000:2.0:1788839552.937090:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645632 00000100:00100000:2.0:1788839552.937123:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788839552.937129:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:9812:x1875734060645632:12345-0@lo:502: 00000100:00100000:2.0:1788839552.937224:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:9812:x1875734060645632:12345-0@lo:502: Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.937230:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788839552.937312:0:9812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9812:1875734060645632:0@lo:502: 00000100:00100000:0.0:1788839552.937351:0:9812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9812:1875734060645760:0@lo:502: 00000100:00100000:0.0:1788839552.937380:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.937445:0:9812:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d793c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.937479:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645760 00000100:00100000:2.0:1788839552.937482:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645760 00000100:00100000:2.0:1788839552.937508:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788839552.937513:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:9812:x1875734060645760:12345-0@lo:502: 00000100:00100000:2.0:1788839552.937569:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:9812:x1875734060645760:12345-0@lo:502: Request processed in 55us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.937576:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788839552.937637:0:9812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9812:1875734060645760:0@lo:502: 00000040:00080000:0.0:1788839552.937653:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788839552.938491:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788839552.938516:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839552.938537:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.938548:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.938559:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788839552.938562:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab745341000 from 6 10000000:01000000:2.0:1788839552.938565:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839552.938593:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.938600:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.938609:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.938625:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060645888:0@lo:101: 00000100:00100000:2.0:1788839552.938662:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.938707:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839552.938755:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060645888 00000100:00100000:0.0:1788839552.939011:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060645888 00000100:00100000:0.0:1788839552.939047:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788839552.939055:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060645888:12345-0@lo:101: 00010000:00010000:0.0:1788839552.939065:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839552.939077:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740030e00/0xad5b343a26572aa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572a9d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.939113:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740030e00/0xad5b343a26572aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572a9d expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.939123:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740030e00/0xad5b343a26572aa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a9d expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839552.939144:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740030e00, rc 0) 00000100:00100000:0.0:1788839552.939176:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060645888:12345-0@lo:101: Request processed in 122us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.939182:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788839552.939272:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060645888:0@lo:101: 00010000:00010000:2.0:1788839552.939285:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939293:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.939334:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646016:0@lo:256: 00000100:00100000:2.0:1788839552.939382:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.939403:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.939414:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646016 00000100:00100000:2.0:1788839552.939417:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646016 00000100:00100000:2.0:1788839552.939438:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788839552.939443:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060646016:12345-0@lo:256: 20000000:01000000:2.0:1788839552.939455:0:6480:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788839552.939472:0:6480:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788839552.939475:0:6480:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788839552.939555:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060646016:12345-0@lo:256: Request processed in 110us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.939563:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788839552.939593:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646016:0@lo:256: 10000000:01000000:2.0:1788839552.939632:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788839552.939638:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939644:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.939651:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788839552.939653:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788839552.939656:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788839552.939669:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939675:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939702:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.939711:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646144:0@lo:101: 00000100:00100000:2.0:1788839552.939732:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.939744:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.939756:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646144 00000100:00100000:2.0:1788839552.939797:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646144 00000100:00100000:2.0:1788839552.939822:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788839552.939829:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060646144:12345-0@lo:101: 00010000:00010000:2.0:1788839552.939836:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839552.939858:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572aab expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939873:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572aab expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939881:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572aab expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.939888:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839552.939912:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060646144:12345-0@lo:101: Request processed in 85us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.939916:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788839552.940346:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646144:0@lo:101: 00010000:00010000:2.0:1788839552.940358:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.940389:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.940440:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646272:0@lo:501: 00000100:00100000:2.0:1788839552.940466:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.940480:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.940492:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646272 00000100:00100000:2.0:1788839552.940495:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646272 00000100:00100000:2.0:1788839552.940517:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788839552.940523:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060646272:12345-0@lo:501: 00000100:00100000:2.0:1788839552.940626:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060646272:12345-0@lo:501: Request processed in 103us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.940633:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788839552.940661:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646272:0@lo:501: 00000100:00100000:2.0:1788839552.940693:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646400:0@lo:503: 00000100:00100000:2.0:1788839552.940728:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.940740:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.940750:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646400 00000100:00100000:2.0:1788839552.940753:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646400 00000100:00100000:2.0:1788839552.940807:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788839552.940813:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060646400:12345-0@lo:503: 00000100:00100000:2.0:1788839552.940891:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060646400:12345-0@lo:503: Request processed in 76us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.940896:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788839552.941129:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646400:0@lo:503: 00000100:00100000:0.0:1788839552.943758:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9813:1875734060646528:0@lo:502: 00000100:00100000:2.0:1788839552.944078:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.944215:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.944254:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646528 00000100:00100000:3.0:1788839552.944261:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646528 00000100:00100000:3.0:1788839552.944332:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788839552.944341:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:9813:x1875734060646528:12345-0@lo:502: 00000100:00100000:3.0:1788839552.944483:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:9813:x1875734060646528:12345-0@lo:502: Request processed in 144us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839552.944490:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788839552.944564:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9813:1875734060646528:0@lo:502: 00000020:01000000:0.0:1788839552.944591:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788839552.944599:0:9813:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788839552.944606:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839552.944608:0:9813:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788839552.944612:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788839552.944616:0:9813:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:0.0:1788839552.944638:0:9813:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788839552.944640:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788839552.944666:0:9813:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab6479e99b8) 00000020:00000080:0.0:1788839552.944702:0:9813:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788839552.944710:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788839552.944826:0:9813:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788839552.944831:0:9813:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788839552.944839:0:9813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26572ac0 00010000:00080000:0.0:1788839552.944871:0:9813:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab646b62800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788839552.945739:0:9813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788839552.945934:0:9813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788839552.946024:0:9813:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788839552.946282:0:9813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839552.946430:0:9813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839552.946576:0:9813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788839552.946705:0:9813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 40000000:02000000:2.0:1788839552.947745:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000004:00080000:1.0:1788839552.947788:0:7420:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000040:00080000:0.0:1788839552.948285:0:9814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839552.948289:0:9814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1788839552.955021:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8412:x1875734060645504:12345-0@lo:700: Request processed in 19333us (19395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.955035:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788839552.955268:0:8412:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5a680 x1875734060645504/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788839568 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839552.955283:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8412:1875734060645504:0@lo:700: 40000000:02000000:0.0:1788839552.955297:0:8412:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:3.0:1788839552.963559:0:9813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839552.963578:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000001:00100000:0.0:1788839552.964044:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788839552.964169:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9811:x1875734060645376:12345-0@lo:700: Request processed in 28606us (29726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839552.964180:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000004:01000000:3.0:1788839552.965865:0:9813:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788839552.965902:0:9813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26572ac7 00000100:00080000:3.0:1788839552.965913:0:9813:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839552.965919:0:9813:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab646b62800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839552.965957:0:9813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab646b4c380 x1875734060646656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839552.966000:0:9813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788839552.966028:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060646656:0@lo:8: 00000020:01000000:3.0:1788839552.966102:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:0.0:1788839552.966106:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788839552.966112:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839552.966116:0:9813:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788839552.966120:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839552.966124:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839552.966126:0:9813:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839552.966131:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839552.966133:0:9813:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788839552.966160:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9813:1875734060646784:0@lo:502: 00000100:00100000:3.0:1788839552.966214:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.966229:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f6c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788839552.966264:0:9811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4d180 x1875734060645376/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788839568 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839552.966278:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060645376:0@lo:700: 00000100:00100000:2.0:1788839552.966288:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646784 00000100:00100000:2.0:1788839552.966296:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646784 00000100:00100000:2.0:1788839552.966340:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788839552.966362:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:9813:x1875734060646784:12345-0@lo:502: 00000100:00100000:2.0:1788839552.966483:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:9813:x1875734060646784:12345-0@lo:502: Request processed in 123us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.966490:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788839552.966666:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646656 00000100:00100000:1.0:1788839552.966671:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646656 00000100:00100000:1.0:1788839552.966707:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839552.966712:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060646656:12345-0@lo:8: 00010000:00080000:1.0:1788839552.966736:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 207 last 0 00000020:00000080:1.0:1788839552.966763:0:8403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26572ace 00002000:00100000:1.0:1788839552.966797:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab646537800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788839552.966802:0:8403:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788839552.966805:0:8403:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788839552.966878:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788839552.966906:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8ab646532800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839552.966951:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060646656:12345-0@lo:8: Request processed in 235us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839552.966957:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788839552.966993:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4c380 x1875734060646656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839552.967001:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839552.967007:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788839552.967013:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788839552.967019:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788839552.967020:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b62800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788839552.967029:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788839552.967034:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060646656:0@lo:8: 00000004:00080000:0.0:1788839552.967565:0:9814:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788839552.967615:0:9814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 207911844312ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788839552.967621:0:9814:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788839552.968949:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:9813:1875734060646784:0@lo:502: 00000020:01000000:3.0:1788839552.969703:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839552.969713:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839552.969716:0:9813:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788839552.969721:0:9813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788839552.969944:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788839552.969965:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788839552.969976:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.969987:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839552.969997:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788839552.969999:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab7486e8000 from 1 10000000:01000000:2.0:1788839552.970002:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788839552.970034:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.970043:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.970062:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839552.970083:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646912:0@lo:101: 00000100:00100000:2.0:1788839552.970333:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.970944:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.970965:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060646912 00000100:00100000:2.0:1788839552.970972:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060646912 00000100:00100000:2.0:1788839552.971018:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788839552.971028:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060646912:12345-0@lo:101: 00010000:00010000:2.0:1788839552.971042:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839552.971057:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572ad5 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839552.971066:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788839552.971082:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.971754:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.971765:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843800, rc 0) 00000100:00100000:2.0:1788839552.973946:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060646912:12345-0@lo:101: Request processed in 2911us (3603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.973959:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788839552.978497:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060646912:0@lo:101: 00010000:00010000:3.0:1788839552.978529:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839552.978543:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839552.978635:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060647040:0@lo:501: 00000100:00100000:3.0:1788839552.978707:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839552.978756:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839552.978948:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647040 00000100:00100000:2.0:1788839552.978954:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647040 00000100:00100000:2.0:1788839552.978998:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788839552.979007:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060647040:12345-0@lo:501: 00000100:00100000:2.0:1788839552.979180:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060647040:12345-0@lo:501: Request processed in 174us (473us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839552.979188:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788839552.979238:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060647040:0@lo:501: 10000000:01000000:2.0:1788839552.979267:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788839552.979274:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839552.979282:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839552.983368:0:9811:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788839552.983561:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839552.983583:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060647168:0@lo:13: 00000100:00100000:2.0:1788839552.983659:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.983718:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647168 00000100:00100000:2.0:1788839552.983726:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647168 00000100:00100000:2.0:1788839552.983790:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788839552.983799:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060647168:12345-0@lo:13: 00002000:00000024:2.0:1788839552.983826:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788839552.983880:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060647168:12345-0@lo:13: Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839552.983886:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788839552.983923:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58a80 x1875734060647168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839552.983942:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060647168:0@lo:13: 00000100:00100000:2.0:1788839552.983997:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060647296:0@lo:13: 00000100:00100000:2.0:1788839552.984030:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788839552.984070:0:9815:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788839552.984214:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060647424:0@lo:7: 00000100:00100000:1.0:1788839552.984228:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647296 00000100:00100000:1.0:1788839552.984232:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647296 00000100:00100000:2.0:1788839552.984240:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839552.984262:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647424 00000100:00100000:1.0:1788839552.984264:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839552.984265:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647424 00000100:00100000:1.0:1788839552.984270:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060647296:12345-0@lo:13: 00002000:00000024:1.0:1788839552.984281:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788839552.984286:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839552.984291:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:9815:x1875734060647424:12345-0@lo:7: 00000100:00100000:1.0:1788839552.984314:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060647296:12345-0@lo:13: Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839552.984319:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788839552.984334:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788839552.984353:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5ed80 x1875734060647296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839568 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839552.984365:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060647296:0@lo:13: 00000100:00100000:0.0:1788839552.986169:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060647552:0@lo:7: 00000100:00100000:0.0:1788839552.986234:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839552.986260:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839552.987497:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647552 00000100:00100000:3.0:1788839552.987507:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647552 00000100:00100000:3.0:1788839552.987556:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839552.987565:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9811:x1875734060647552:12345-0@lo:7: 00000100:00100000:0.0:1788839552.992902:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4af00 going to sleep for 11 seconds 00002000:00080000:2.0:1788839553.001518:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788839553.001582:0:8404:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788839553.001694:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9815:x1875734060647424:12345-0@lo:7: Request processed in 17389us (17439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839553.001706:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788839553.001879:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5f100 x1875734060647424/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839568 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839553.001909:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060647424:0@lo:7: 00000004:00080000:1.0:1788839553.001925:0:9815:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788839553.001969:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060647680:0@lo:5: 00000100:00100000:1.0:1788839553.002140:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839553.002179:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4bd80 going to sleep for 10 seconds 00000100:00100000:2.0:1788839553.002423:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647680 00000100:00100000:2.0:1788839553.002430:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647680 00000100:00100000:2.0:1788839553.002476:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788839553.002484:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9815:x1875734060647680:12345-0@lo:5: 00002000:00080000:2.0:1788839553.002509:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788839553.002513:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:0.0:1788839553.014514:0:8538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788839553.014524:0:8538:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788839553.014620:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9811:x1875734060647552:12345-0@lo:7: Request processed in 27052us (28382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839553.014631:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788839553.015897:0:9811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58700 x1875734060647552/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839568 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839553.015914:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060647552:0@lo:7: 00000004:00080000:0.0:1788839553.015931:0:9811:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788839553.015972:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060647808:0@lo:5: 00000100:00100000:0.0:1788839553.016139:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839553.016184:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839553.016292:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647808 00000100:00100000:2.0:1788839553.016299:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647808 00000100:00100000:2.0:1788839553.016344:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839553.016354:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:9811:x1875734060647808:12345-0@lo:5: 00002000:00080000:2.0:1788839553.016381:0:8539:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788839553.016425:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:9811:x1875734060647808:12345-0@lo:5: Request processed in 73us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839553.016432:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788839553.016566:0:9811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58700 x1875734060647808/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839569 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839553.016577:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060647808:0@lo:5: 00000004:00080000:0.0:1788839553.016586:0:9811:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788839553.016609:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060647936:0@lo:5: 00000100:00100000:0.0:1788839553.016636:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839553.016662:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839553.016677:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060647936 00000100:00100000:0.0:1788839553.016691:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060647936 00000100:00100000:0.0:1788839553.016729:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839553.016736:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9811:x1875734060647936:12345-0@lo:5: 00002000:00080000:0.0:1788839553.016761:0:8538:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788839553.025458:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:9811:x1875734060647936:12345-0@lo:5: Request processed in 8715us (8814us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788839553.025471:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788839553.027965:0:9811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58700 x1875734060647936/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839569 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839553.027988:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9811:1875734060647936:0@lo:5: 00000004:00080000:1.0:1788839553.028004:0:9811:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788839553.028049:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9811:1875734060648064:0@lo:900: 00000100:00100000:1.0:1788839553.028110:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1788839553.028912:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788839553.029007:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788839553.029116:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9815:x1875734060647680:12345-0@lo:5: Request processed in 26630us (26973us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788839553.029125:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839553.029996:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4ba80 going to sleep for 11 seconds 00010000:00080000:1.0:1788839553.030036:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e4700 x1875734060647680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839568 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839553.030047:0:9815:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788839553.030052:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060647680:0@lo:5: 00000004:00080000:1.0:1788839553.030064:0:9815:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788839553.030112:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060648192:0@lo:700: 00000100:00100000:1.0:1788839553.030153:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839553.030188:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839553.030350:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648192 00000100:00100000:2.0:1788839553.030358:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648192 00000100:00100000:2.0:1788839553.030408:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839553.030418:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9815:x1875734060648192:12345-0@lo:700: 00000100:00100000:0.0:1788839553.030628:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648064 00000100:00100000:0.0:1788839553.030633:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648064 00000100:00100000:0.0:1788839553.030669:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839553.030678:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9811:x1875734060648064:12345-0@lo:900: 00000100:00100000:0.0:1788839553.030745:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9811:x1875734060648064:12345-0@lo:900: Request processed in 68us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839553.030752:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788839553.030883:0:9811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e7800 x1875734060648064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839569 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839553.030894:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9811:1875734060648064:0@lo:900: 00000001:00080000:1.0:1788839553.033481:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788839553.033725:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9815:x1875734060648192:12345-0@lo:700: Request processed in 3248us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839553.033738:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788839553.033904:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e4700 x1875734060648192/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788839569 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839553.033919:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060648192:0@lo:700: 00000004:02000040:1.0:1788839553.035550:0:9815:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788839553.045156:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060648320:0@lo:5: 00000100:00100000:0.0:1788839553.045223:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839553.045281:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f68d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839553.045397:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648320 00000100:00100000:1.0:1788839553.045405:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648320 00000100:00100000:1.0:1788839553.045508:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839553.045519:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9815:x1875734060648320:12345-0@lo:5: 00002000:00080000:0.0:1788839553.054921:0:8404:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788839553.054944:0:8404:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788839553.056411:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9815:x1875734060648320:12345-0@lo:5: Request processed in 10888us (11180us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788839553.056422:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788839553.056617:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ec000 x1875734060648320/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839569 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839553.056633:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9815:1875734060648320:0@lo:5: 00000004:00080000:3.0:1788839553.056648:0:9815:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:3.0:1788839553.296979:0:9854:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788839553.407067:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060648448:0@lo:41: 00000100:00100000:2.0:1788839553.407147:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839553.407261:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648448 00000100:00100000:3.0:1788839553.407270:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648448 00000100:00100000:3.0:1788839553.407326:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839553.407336:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060648448:12345-0@lo:41: 00000004:00000024:3.0:1788839553.407380:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788839553.407429:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060648448:12345-0@lo:41: Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839553.407436:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839553.407511:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060648448:0@lo:41: 00010000:00010000:0.0:1788839553.854880:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788839554.201213:0:9906:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839554.201626:0:9906:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788839554.882632:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788839555.168172:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1788839555.457706:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060648576:0@lo:41: 00000100:00100000:0.0:1788839555.457825:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839555.457978:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648576 00000100:00100000:3.0:1788839555.457986:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648576 00000100:00100000:3.0:1788839555.458037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788839555.458046:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060648576:12345-0@lo:41: 00000004:00000024:3.0:1788839555.458080:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839555.458133:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060648576:12345-0@lo:41: Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839555.458141:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839555.458229:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060648576:0@lo:41: 00010000:00010000:0.0:1788839555.902950:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839556.927854:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788839557.118681:0:10008:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839557.119027:0:10008:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788839557.951950:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788839557.981548:0:10056:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839557.981559:0:10056:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788839558.015448:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060648960:0@lo:400: 00000100:00100000:3.0:1788839558.016533:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839558.016835:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060649472:0@lo:400: 00000100:00100000:3.0:1788839558.016871:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839558.016893:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060649984:0@lo:400: 00000100:00100000:3.0:1788839558.016919:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839558.016955:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788839558.016961:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060648832:0@lo:400: 00000100:00100000:3.0:1788839558.016986:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839558.017009:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060649344:0@lo:400: 00000100:00100000:1.0:1788839558.018788:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060648704:0@lo:400: 00000100:00100000:1.0:1788839558.018842:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.018877:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060649216:0@lo:400: 00000100:00100000:1.0:1788839558.018899:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.018917:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060649728:0@lo:400: 00000100:00100000:1.0:1788839558.018937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.018952:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060650240:0@lo:400: 00000100:00100000:1.0:1788839558.018968:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.018986:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788839558.018991:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060649088:0@lo:400: 00000100:00100000:1.0:1788839558.019009:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.019022:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060649600:0@lo:400: 00000100:00100000:1.0:1788839558.019037:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.019057:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060650112:0@lo:400: 00000100:00100000:1.0:1788839558.019072:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.019093:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060650368:0@lo:13: 00000100:00100000:1.0:1788839558.019111:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.019199:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648704 00000100:00100000:1.0:1788839558.019205:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648704 00000100:00100000:1.0:1788839558.019247:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788839558.019255:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060648704:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019295:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060648704:12345-0@lo:400: Request processed in 41us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019302:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788839558.019330:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648960 00000100:00100000:1.0:1788839558.019333:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648960 00000100:00100000:1.0:1788839558.019349:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649216 00000100:00100000:1.0:1788839558.019351:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649216 00000100:00100000:1.0:1788839558.019363:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839558.019368:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060648960:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019401:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060648960:12345-0@lo:400: Request processed in 33us (2873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019406:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839558.019418:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839558.019423:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060649216:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019448:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060649216:12345-0@lo:400: Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019454:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839558.019472:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649728 00000100:00100000:1.0:1788839558.019476:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649728 00000100:00100000:1.0:1788839558.019513:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650240 00000100:00100000:1.0:1788839558.019517:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650240 00000100:00100000:1.0:1788839558.019527:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649600 00000100:00100000:1.0:1788839558.019529:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649600 00000100:00100000:1.0:1788839558.019540:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650112 00000100:00100000:1.0:1788839558.019543:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650112 00000100:00100000:1.0:1788839558.019554:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839558.019559:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060649728:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019589:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060649728:12345-0@lo:400: Request processed in 29us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019594:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839558.019604:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839558.019610:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060650240:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019633:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060650240:12345-0@lo:400: Request processed in 24us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019638:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839558.019659:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839558.019664:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060649600:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019688:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060649600:12345-0@lo:400: Request processed in 24us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019693:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839558.019701:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839558.019706:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060650112:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019725:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060650112:12345-0@lo:400: Request processed in 19us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019730:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839558.019746:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649472 00000100:00100000:1.0:1788839558.019749:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649472 00000100:00100000:1.0:1788839558.019796:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649984 00000100:00100000:1.0:1788839558.019799:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649984 00000100:00100000:1.0:1788839558.019811:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060648832 00000100:00100000:1.0:1788839558.019813:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060648832 00000100:00100000:1.0:1788839558.019822:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649088 00000100:00100000:1.0:1788839558.019824:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649088 00000100:00100000:1.0:1788839558.019834:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839558.019839:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060649472:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019866:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060649472:12345-0@lo:400: Request processed in 27us (2995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019871:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839558.019881:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839558.019886:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060649984:12345-0@lo:400: 00000100:00100000:1.0:1788839558.019917:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060649984:12345-0@lo:400: Request processed in 31us (2997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019925:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788839558.019936:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.019940:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839558.019949:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060648832:12345-0@lo:400: 00000100:00100000:3.0:1788839558.019961:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060649856:0@lo:400: 00000100:00100000:1.0:1788839558.019985:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060648832:12345-0@lo:400: Request processed in 37us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.019993:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839558.020003:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649344 00000100:00100000:1.0:1788839558.020007:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649344 00000100:00100000:1.0:1788839558.020023:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839558.020028:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060649088:12345-0@lo:400: 00000100:00100000:3.0:1788839558.020038:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.020069:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060649088:12345-0@lo:400: Request processed in 40us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.020075:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788839558.020079:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060648960:0@lo:400: 00000100:00100000:1.0:1788839558.020099:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060649856 00010000:00080000:3.0:1788839558.020101:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a30a80 x1875734060649472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020103:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060649856 00000100:00100000:3.0:1788839558.020116:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060649472:0@lo:400: 00000100:00100000:1.0:1788839558.020125:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839558.020135:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060649344:12345-0@lo:400: 00010000:00080000:3.0:1788839558.020141:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a31f80 x1875734060649984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839558.020154:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060649984:0@lo:400: 00000100:00100000:1.0:1788839558.020169:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060649344:12345-0@lo:400: Request processed in 36us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.020176:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788839558.020187:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5c700 x1875734060648832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020192:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839558.020203:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060649856:12345-0@lo:400: 00000100:00100000:3.0:1788839558.020204:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060648832:0@lo:400: 00010000:00080000:3.0:1788839558.020221:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a30700 x1875734060649344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839558.020231:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060649344:0@lo:400: 00000100:00100000:1.0:1788839558.020239:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060649856:12345-0@lo:400: Request processed in 37us (236us total) trans 0 rc 0/0 00010000:00080000:3.0:1788839558.020245:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a30e00 x1875734060649856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020246:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839558.020259:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060649856:0@lo:400: 00000100:00100000:1.0:1788839558.020281:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650368 00000100:00100000:1.0:1788839558.020286:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650368 00000100:00100000:1.0:1788839558.020314:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839558.020321:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060650368:12345-0@lo:13: 00002000:00000024:1.0:1788839558.020345:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839558.020377:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060650368:12345-0@lo:13: Request processed in 56us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.020382:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788839558.020402:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839558.020406:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839558.020409:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839558.020411:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788839558.020435:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5e300 x1875734060649088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020446:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060649088:0@lo:400: 00010000:00080000:1.0:1788839558.020456:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a33800 x1875734060649600/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020473:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060649600:0@lo:400: 00010000:00080000:1.0:1788839558.020485:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a32a00 x1875734060650112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020492:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788839558.020503:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060650112:0@lo:400: 00000100:00100000:1.0:1788839558.020513:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060648704:0@lo:400: 00000100:00100000:1.0:1788839558.020524:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060649216:0@lo:400: 00010000:00080000:1.0:1788839558.020535:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a31880 x1875734060649728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020543:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060649728:0@lo:400: 00010000:00080000:1.0:1788839558.020553:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a33b80 x1875734060650240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.020559:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788839558.020567:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060650240:0@lo:400: 00010000:00080000:3.0:1788839558.020730:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e4700 x1875734060650368/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839558.020745:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060650368:0@lo:13: 00000100:00100000:3.0:1788839558.020758:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839558.020764:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060650496:0@lo:13: 00000100:00100000:3.0:1788839558.020888:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839558.020962:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650496 00000100:00100000:1.0:1788839558.020968:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650496 00000100:00100000:1.0:1788839558.021001:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839558.021008:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060650496:12345-0@lo:13: 00002000:00000024:1.0:1788839558.021020:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839558.021054:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060650496:12345-0@lo:13: Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.021061:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788839558.021094:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4c380 x1875734060650496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839558.021106:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060650496:0@lo:13: 00000100:00100000:3.0:1788839558.023510:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060650624:0@lo:13: 00000100:00100000:3.0:1788839558.023579:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839558.023635:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839558.023643:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060650752:0@lo:13: 00000100:00100000:0.0:1788839558.023668:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650624 00000100:00100000:0.0:1788839558.023676:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650624 00000100:00100000:3.0:1788839558.023681:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839558.023715:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650752 00000100:00100000:0.0:1788839558.023718:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650752 00000100:00100000:0.0:1788839558.023733:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839558.023742:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060650624:12345-0@lo:13: 00002000:00000024:0.0:1788839558.023787:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839558.023838:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060650624:12345-0@lo:13: Request processed in 97us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839558.023859:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839558.023881:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839558.023888:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060650752:12345-0@lo:13: 00002000:00000024:0.0:1788839558.023898:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788839558.023932:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ae300 x1875734060650624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839558.023932:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060650752:12345-0@lo:13: Request processed in 42us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839558.023948:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839558.023963:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060650624:0@lo:13: 00010000:00080000:3.0:1788839558.023985:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e42d80 x1875734060650752/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839558.023997:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060650752:0@lo:13: 00000100:00100000:3.0:1788839558.477371:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.477822:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050111616 00000100:00100000:2.0:1788839558.477832:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050111616 00000100:00100000:2.0:1788839558.477883:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:2.0:1788839558.477891:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2388:x1875734050111616:12345-192.168.203.52@tcp:250: 00010000:00080000:2.0:1788839558.477922:0:6481:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a94babf6-f8ea-4a10-a503-aad078d53639@192.168.203.52@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788839558.477952:0:6481:0:(genops.c:1385:class_connect()) connect: client a94babf6-f8ea-4a10-a503-aad078d53639, cookie 0xad5b343a26572ae3 00000100:00080000:2.0:1788839558.478100:0:6481:0:(import.c:65:import_set_state_nolock()) ffff8ab646b39800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839558.478176:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+5:2388:x1875734050111616:12345-192.168.203.52@tcp:250: Request processed in 284us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.478183:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:0.0:1788839558.484194:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839558.484818:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050111744 00000100:00100000:1.0:1788839558.484831:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050111744 00000100:00100000:1.0:1788839558.484895:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:1.0:1788839558.484906:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+5:6151:x1875734050111744:12345-192.168.203.52@tcp:101: 00010000:00010000:1.0:1788839558.484925:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839558.484944:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e746b8 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839558.484985:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839558.485000:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 6 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839558.485010:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:1.0:1788839558.485071:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+6:6151:x1875734050111744:12345-192.168.203.52@tcp:101: Request processed in 167us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.485079:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:0.0:1788839558.490543:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839558.490630:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050111872 00000100:00100000:1.0:1788839558.490639:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050111872 00000100:00100000:1.0:1788839558.490711:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:1.0:1788839558.490722:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+6:6151:x1875734050111872:12345-192.168.203.52@tcp:501: 00000100:00100000:1.0:1788839558.490867:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+6:6151:x1875734050111872:12345-192.168.203.52@tcp:501: Request processed in 146us (333us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839558.490905:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:3.0:1788839558.493928:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.494066:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112000 00000100:00100000:2.0:1788839558.494092:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112000 00000100:00100000:2.0:1788839558.494150:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:2.0:1788839558.494161:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+6:6151:x1875734050112000:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788839558.494177:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839558.494196:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e746bf expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839558.494224:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839558.494236:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839558.494246:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842000, rc 0) 00000100:00100000:2.0:1788839558.494307:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+7:6151:x1875734050112000:12345-192.168.203.52@tcp:101: Request processed in 148us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.494315:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:0.0:1788839558.504036:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.504172:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112128 00000100:00100000:2.0:1788839558.504183:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112128 00000100:00100000:2.0:1788839558.504244:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:2.0:1788839558.504254:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+7:6151:x1875734050112128:12345-192.168.203.52@tcp:501: 00000100:00100000:2.0:1788839558.504427:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+8:6151:x1875734050112128:12345-192.168.203.52@tcp:501: Request processed in 174us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.504435:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:0.0:1788839558.508436:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839558.509133:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112256 00000100:00100000:1.0:1788839558.509146:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112256 00000100:00100000:1.0:1788839558.509223:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:1.0:1788839558.509235:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+8:6151:x1875734050112256:12345-192.168.203.52@tcp:503: 00000100:00100000:1.0:1788839558.509401:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+8:6151:x1875734050112256:12345-192.168.203.52@tcp:503: Request processed in 168us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.509409:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:3.0:1788839558.512238:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.512347:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112384 00000100:00100000:2.0:1788839558.512357:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112384 00000100:00100000:2.0:1788839558.512413:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:2.0:1788839558.512425:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+8:6169:x1875734050112384:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788839558.512590:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+8:6169:x1875734050112384:12345-192.168.203.52@tcp:502: Request processed in 167us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.512598:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:0.0:1788839558.527565:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839558.527593:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060650880:0@lo:41: 00000100:00100000:0.0:1788839558.527674:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839558.528202:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060650880 00000100:00100000:3.0:1788839558.528210:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060650880 00000100:00100000:3.0:1788839558.528267:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788839558.528277:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060650880:12345-0@lo:41: 00000004:00000024:3.0:1788839558.528311:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788839558.528366:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060650880:12345-0@lo:41: Request processed in 90us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839558.528373:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839558.528494:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060650880:0@lo:41: 00000100:00100000:0.0:1788839558.569521:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839558.569591:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112512 00000100:00100000:3.0:1788839558.569600:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112512 00000100:00100000:3.0:1788839558.569663:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:3.0:1788839558.569686:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+8:6169:x1875734050112512:12345-192.168.203.52@tcp:502: 00000100:00100000:3.0:1788839558.569865:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+8:6169:x1875734050112512:12345-192.168.203.52@tcp:502: Request processed in 181us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839558.569873:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:0.0:1788839558.580336:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839558.580944:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112640 00000100:00100000:1.0:1788839558.580954:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112640 00000100:00100000:1.0:1788839558.581019:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1788839558.581029:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+8:6151:x1875734050112640:12345-192.168.203.52@tcp:101: 00010000:00010000:1.0:1788839558.581044:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839558.581061:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552000/0xad5b343a26572af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e746f0 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839558.581092:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552000/0xad5b343a26572af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f0 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839558.581103:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552000/0xad5b343a26572af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f0 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839558.581111:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552000, rc 0) 00000100:00100000:1.0:1788839558.581172:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+9:6151:x1875734050112640:12345-192.168.203.52@tcp:101: Request processed in 145us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.581197:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1788839558.587453:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839558.587589:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112768 00000100:00100000:3.0:1788839558.587601:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112768 00000100:00100000:3.0:1788839558.587671:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:3.0:1788839558.587683:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+9:6151:x1875734050112768:12345-192.168.203.52@tcp:256: 20000000:01000000:3.0:1788839558.587711:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788839558.587738:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788839558.587741:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788839558.587744:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788839558.587747:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788839558.587749:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788839558.591191:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+9:6151:x1875734050112768:12345-192.168.203.52@tcp:256: Request processed in 3500us (3740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.591206:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788839558.596665:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.596760:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050112896 00000100:00100000:2.0:1788839558.596797:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050112896 00000100:00100000:2.0:1788839558.596862:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:2.0:1788839558.596872:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+9:6151:x1875734050112896:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788839558.596889:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839558.596908:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e746f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839558.596937:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839558.596948:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839558.596957:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842c00, rc 0) 00000100:00100000:2.0:1788839558.597024:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:6151:x1875734050112896:12345-192.168.203.52@tcp:101: Request processed in 154us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.597031:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:1.0:1788839558.599361:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.599506:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113024 00000100:00100000:2.0:1788839558.599522:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113024 00000100:00100000:2.0:1788839558.599607:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:2.0:1788839558.599618:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:6151:x1875734050113024:12345-192.168.203.52@tcp:501: 00000100:00100000:2.0:1788839558.600028:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:6151:x1875734050113024:12345-192.168.203.52@tcp:501: Request processed in 410us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.600037:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:0.0:1788839558.605856:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839558.605966:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113152 00000100:00100000:1.0:1788839558.605981:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113152 00000100:00100000:1.0:1788839558.606111:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:1.0:1788839558.606123:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6151:x1875734050113152:12345-192.168.203.52@tcp:503: 00000100:00100000:1.0:1788839558.606304:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6151:x1875734050113152:12345-192.168.203.52@tcp:503: Request processed in 182us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.606312:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:0.0:1788839558.616530:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.616698:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113280 00000100:00100000:2.0:1788839558.616709:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113280 00000100:00100000:1.0:1788839558.616852:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788839558.616864:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:6174:x1875734050113280:12345-192.168.203.52@tcp:502: 00000100:00100000:1.0:1788839558.617367:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:6174:x1875734050113280:12345-192.168.203.52@tcp:502: Request processed in 503us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839558.617376:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788839558.620373:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839558.620532:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113408 00000100:00100000:2.0:1788839558.620543:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113408 00000100:00100000:2.0:1788839558.620603:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1788839558.620613:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6174:x1875734050113408:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788839558.621412:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6174:x1875734050113408:12345-192.168.203.52@tcp:502: Request processed in 797us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.621421:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1788839558.628827:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839558.628863:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839558.629056:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113536 00000100:00100000:3.0:1788839558.629068:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113536 00000100:00100000:3.0:1788839558.629115:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113792 00000100:00100000:3.0:1788839558.629118:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113792 00000100:00100000:3.0:1788839558.629149:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788839558.629157:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1875734050113536:12345-192.168.203.52@tcp:38: 00010000:00080000:3.0:1788839558.629186:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:3.0:1788839558.629239:0:6489:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26572b06 00000004:00100000:3.0:1788839558.629266:0:6489:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788839558.629489:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8ab647a25800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839558.629670:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788839558.629678:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1875734050113792:12345-192.168.203.52@tcp:38: 00010000:00080000:2.0:1788839558.629696:0:7438:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788839558.629728:0:7438:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26572b0d 00000004:00100000:2.0:1788839558.629740:0:7438:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788839558.629915:0:7438:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839558.629954:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050113792:12345-192.168.203.52@tcp:38: Request processed in 275us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839558.629962:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788839558.630197:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050113536:12345-192.168.203.52@tcp:38: Request processed in 1038us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839558.630204:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00010000:00010000:1.0:1788839558.975864:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839559.384884:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839559.385026:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113920 00000100:00100000:2.0:1788839559.385044:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113920 00000100:00100000:2.0:1788839559.385127:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839559.385137:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:0:x1875734050113920:12345-192.168.203.52@tcp:41: 00000004:00000024:2.0:1788839559.385193:0:7438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839559.385273:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:0:x1875734050113920:12345-192.168.203.52@tcp:41: Request processed in 138us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839559.385280:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:1.0:1788839559.386090:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839559.386304:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839559.386339:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839559.386406:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114048 00000100:00100000:3.0:1788839559.386412:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114048 00000100:00100000:3.0:1788839559.386468:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050113664 00000100:00100000:3.0:1788839559.386472:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050113664 00000100:00100000:3.0:1788839559.386496:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788839559.386504:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:6151:x1875734050114048:12345-192.168.203.52@tcp:41: 00000004:00000024:3.0:1788839559.386540:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788839559.386663:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788839559.386673:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:0:x1875734050113664:12345-192.168.203.52@tcp:41: 00000004:00000024:0.0:1788839559.386685:0:7438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788839559.386720:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:0:x1875734050113664:12345-192.168.203.52@tcp:41: Request processed in 51us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839559.386737:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788839559.387301:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114048:12345-192.168.203.52@tcp:41: Request processed in 795us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839559.387309:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:2.0:1788839559.387668:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839559.396352:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839559.397619:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114176 00000100:00100000:0.0:1788839559.397632:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114176 00000100:00100000:0.0:1788839559.397710:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788839559.397720:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114176:12345-192.168.203.52@tcp:40: 00000100:00100000:0.0:1788839559.397835:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114176:12345-192.168.203.52@tcp:40: Request processed in 117us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839559.397843:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788839559.405218:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839559.405264:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839559.405297:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839559.405333:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839559.405474:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114304 00000100:00100000:2.0:1788839559.405483:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114304 00000100:00100000:2.0:1788839559.405533:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114432 00000100:00100000:2.0:1788839559.405536:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114432 00000100:00100000:2.0:1788839559.405558:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788839559.405573:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1875734050114304:12345-192.168.203.52@tcp:8: 00010000:00080000:2.0:1788839559.405607:0:8539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1788839559.405648:0:8539:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26572b14 00002000:00100000:2.0:1788839559.405660:0:8539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c22f38d-5944-4459-a83e-bcbd490346fb/ffff8ab646b3a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839559.405677:0:8539:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788839559.405909:0:8539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788839559.405940:0:8539:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839559.405981:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788839559.405989:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1875734050114432:12345-192.168.203.52@tcp:8: 00000100:00100000:2.0:1788839559.406007:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050114304:12345-192.168.203.52@tcp:8: Request processed in 439us (741us total) trans 0 rc 0/0 00010000:00080000:3.0:1788839559.406014:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 214 last 0 00000100:00100000:2.0:1788839559.406020:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000020:00000080:3.0:1788839559.406035:0:8405:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26572b1b 00002000:00100000:3.0:1788839559.406041:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c22f38d-5944-4459-a83e-bcbd490346fb/ffff8ab647a22000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788839559.406054:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788839559.406204:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788839559.406220:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab647a21000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839559.406264:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050114432:12345-192.168.203.52@tcp:8: Request processed in 273us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839559.406272:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788839559.406372:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114560 00000100:00100000:1.0:1788839559.406378:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114560 00000100:00100000:1.0:1788839559.406426:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788839559.406434:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114560:12345-192.168.203.52@tcp:900: 00000100:00100000:1.0:1788839559.406475:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114560:12345-192.168.203.52@tcp:900: Request processed in 42us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839559.406482:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788839559.406513:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114688 00000100:00100000:1.0:1788839559.406518:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114688 00000100:00100000:1.0:1788839559.406545:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:1.0:1788839559.406553:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050114688:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839559.406607:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050114688:12345-192.168.203.52@tcp:400: Request processed in 54us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839559.406613:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1788839559.414233:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839559.414411:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114816 00000100:00100000:1.0:1788839559.414422:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114816 00000100:00100000:1.0:1788839559.414480:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1788839559.414490:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114816:12345-192.168.203.52@tcp:33: 00000004:00080000:1.0:1788839559.452346:0:6490:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37752us 00000004:00200000:0.0:1788839559.506592:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788839559.506731:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6151:x1875734050114816:12345-192.168.203.52@tcp:33: Request processed in 92237us (92504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839559.506747:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788839559.743666:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839559.743821:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050114944 00000100:00100000:1.0:1788839559.743832:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050114944 00000100:00100000:1.0:1788839559.743895:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788839559.743906:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6192:x1875734050114944:12345-192.168.203.52@tcp:101: 00010000:00010000:1.0:1788839559.743928:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839559.744017:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553400/0xad5b343a26572b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74728 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839559.744089:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26572b29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839559.744103:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26572b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839559.744118:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26572b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839559.744181:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788839559.744198:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839559.744228:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26572b29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839559.744257:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553400/0xad5b343a26572b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74728 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839559.744279:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26572b29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74728 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839559.744288:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab748ac4300) 00010000:00010000:1.0:1788839559.744291:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839559.744294:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552c00, rc 0) 00000100:00100000:1.0:1788839559.744357:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:6192:x1875734050114944:12345-192.168.203.52@tcp:101: Request processed in 453us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839559.744364:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:2.0:1788839560.006779:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839560.580921:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839560.580953:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060651008:0@lo:41: 00000100:00100000:3.0:1788839560.581039:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839560.581176:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651008 00000100:00100000:0.0:1788839560.581184:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651008 00000100:00100000:0.0:1788839560.581238:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839560.581247:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060651008:12345-0@lo:41: 00000004:00000024:0.0:1788839560.581281:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839560.581332:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060651008:12345-0@lo:41: Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839560.581340:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788839560.581838:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060651008:0@lo:41: 00010000:00010000:1.0:1788839561.030810:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839561.874846:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839561.875008:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115072 00000100:00100000:0.0:1788839561.875020:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115072 00000100:00100000:0.0:1788839561.875120:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788839561.875132:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:6244:x1875734050115072:12345-192.168.203.52@tcp:41: 00000100:00080000:2.0:1788839561.875154:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788839561.875169:0:7438:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788839561.875235:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:6244:x1875734050115072:12345-192.168.203.52@tcp:41: Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839561.875241:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788839561.882203:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839561.882576:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115200 00000100:00100000:1.0:1788839561.882587:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115200 00000100:00100000:1.0:1788839561.882677:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788839561.882687:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6244:x1875734050115200:12345-192.168.203.52@tcp:41: 00000004:00000024:1.0:1788839561.882728:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839561.882836:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6244:x1875734050115200:12345-192.168.203.52@tcp:41: Request processed in 150us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839561.882844:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:2.0:1788839561.884484:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839561.889765:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839561.889908:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115328 00000100:00100000:0.0:1788839561.889918:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115328 00000100:00100000:0.0:1788839561.889998:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788839561.890012:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6244:x1875734050115328:12345-192.168.203.52@tcp:13: 00002000:00000024:0.0:1788839561.890048:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839561.890128:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6244:x1875734050115328:12345-192.168.203.52@tcp:13: Request processed in 120us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839561.890136:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00080000:2.0:1788839561.890198:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839561.896604:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839561.896796:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115456 00000100:00100000:3.0:1788839561.896822:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115456 00000100:00100000:3.0:1788839561.896926:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788839561.896936:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6244:x1875734050115456:12345-192.168.203.52@tcp:13: 00002000:00000024:3.0:1788839561.896969:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839561.897041:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4c22f38d-5944-4459-a83e-bcbd490346fb+6:6244:x1875734050115456:12345-192.168.203.52@tcp:13: Request processed in 106us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839561.897047:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:2.0:1788839561.897166:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788839562.050044:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839563.072252:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839563.134979:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060651136:0@lo:13: 00000100:00100000:0.0:1788839563.135067:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839563.136345:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651136 00000100:00100000:2.0:1788839563.136356:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651136 00000100:00100000:2.0:1788839563.136421:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788839563.136432:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060651136:12345-0@lo:13: 00002000:00000024:2.0:1788839563.136461:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839563.136726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060651648:0@lo:400: 00000100:00100000:0.0:1788839563.136781:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839563.137183:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060651136:12345-0@lo:13: Request processed in 752us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.137191:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788839563.137216:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839563.137452:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060651392:0@lo:400: 00000100:00100000:3.0:1788839563.137489:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839563.137513:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060651904:0@lo:400: 00000100:00100000:3.0:1788839563.137534:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839563.137564:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060652416:0@lo:400: 00000100:00100000:3.0:1788839563.137590:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839563.137707:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651392 00000100:00100000:2.0:1788839563.137713:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651392 00000100:00100000:2.0:1788839563.137760:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788839563.137790:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060651392:12345-0@lo:400: 00000100:00100000:2.0:1788839563.137833:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060651392:12345-0@lo:400: Request processed in 66us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.137839:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788839563.137975:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060652928:0@lo:400: 00000100:00100000:3.0:1788839563.138078:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839563.138119:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060651392:0@lo:400: 00000100:00100000:3.0:1788839563.138135:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788839563.138141:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060651520:0@lo:400: 00000100:00100000:3.0:1788839563.138163:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839563.138179:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060652032:0@lo:400: 00000100:00100000:3.0:1788839563.138199:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839563.138215:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060652544:0@lo:400: 00000100:00100000:3.0:1788839563.138233:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839563.138714:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652416 00000100:00100000:2.0:1788839563.138722:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652416 00000100:00100000:2.0:1788839563.138849:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652928 00000100:00100000:2.0:1788839563.138853:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652928 00000100:00100000:2.0:1788839563.138892:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652544 00000100:00100000:2.0:1788839563.138895:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652544 00000100:00100000:2.0:1788839563.138910:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839563.138917:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060652416:12345-0@lo:400: 00000100:00100000:2.0:1788839563.138968:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060652416:12345-0@lo:400: Request processed in 51us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.138974:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839563.139061:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839563.139071:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060652928:12345-0@lo:400: 00000100:00100000:2.0:1788839563.139101:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060652928:12345-0@lo:400: Request processed in 32us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.139106:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839563.139118:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788839563.139123:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060652544:12345-0@lo:400: 00000100:00100000:2.0:1788839563.139148:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060652544:12345-0@lo:400: Request processed in 26us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.139154:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788839563.139170:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839563.139174:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839563.139343:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651904 00000100:00100000:1.0:1788839563.139354:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651904 00000100:00100000:1.0:1788839563.139380:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651520 00000100:00100000:1.0:1788839563.139383:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651520 00000100:00100000:1.0:1788839563.139401:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788839563.139407:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060651904:12345-0@lo:400: 00000100:00100000:1.0:1788839563.139441:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060651904:12345-0@lo:400: Request processed in 35us (1906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.139448:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788839563.139460:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839563.139466:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060651520:12345-0@lo:400: 00000100:00100000:1.0:1788839563.139491:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060651520:12345-0@lo:400: Request processed in 26us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.139497:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839563.140881:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651648 00000100:00100000:2.0:1788839563.140894:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651648 00000100:00100000:2.0:1788839563.140931:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652032 00000100:00100000:2.0:1788839563.140934:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652032 00000100:00100000:2.0:1788839563.140951:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839563.140958:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060651648:12345-0@lo:400: 00000100:00100000:2.0:1788839563.141046:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060651648:12345-0@lo:400: Request processed in 88us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.141053:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839563.141079:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839563.141086:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060652032:12345-0@lo:400: 00000100:00100000:2.0:1788839563.141120:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060652032:12345-0@lo:400: Request processed in 34us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.141125:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788839563.141872:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060651264:0@lo:13: 00000100:00100000:1.0:1788839563.141918:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839563.141949:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060651776:0@lo:13: 00000100:00100000:1.0:1788839563.142062:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839563.142086:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060652288:0@lo:400: 00000100:00100000:1.0:1788839563.142114:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839563.142132:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060652800:0@lo:400: 00000100:00100000:1.0:1788839563.142156:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839563.142180:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788839563.142186:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060652160:0@lo:400: 00000100:00100000:1.0:1788839563.142209:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839563.142226:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060652672:0@lo:400: 00000100:00100000:1.0:1788839563.142248:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839563.142323:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651264 00000100:00100000:1.0:1788839563.142329:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651264 00000100:00100000:1.0:1788839563.142355:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060651776 00000100:00100000:1.0:1788839563.142358:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060651776 00000100:00100000:1.0:1788839563.142373:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788839563.142380:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060651264:12345-0@lo:13: 00002000:00000024:1.0:1788839563.142407:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839563.142449:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060651264:12345-0@lo:13: Request processed in 68us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.142455:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788839563.142469:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839563.142475:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060651776:12345-0@lo:13: 00002000:00000024:1.0:1788839563.142486:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839563.142512:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060651776:12345-0@lo:13: Request processed in 37us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.142518:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788839563.142538:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652288 00000100:00100000:1.0:1788839563.142543:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652288 00000100:00100000:1.0:1788839563.142570:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652800 00000100:00100000:1.0:1788839563.142573:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652800 00000100:00100000:1.0:1788839563.142584:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652160 00000100:00100000:1.0:1788839563.142586:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652160 00000100:00100000:1.0:1788839563.142596:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060652672 00000100:00100000:1.0:1788839563.143703:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060652672 00000100:00100000:1.0:1788839563.143836:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839563.143845:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060652288:12345-0@lo:400: 00000100:00100000:1.0:1788839563.143915:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060652288:12345-0@lo:400: Request processed in 73us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.143923:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839563.143945:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839563.143951:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060652800:12345-0@lo:400: 00000100:00100000:1.0:1788839563.143979:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060652800:12345-0@lo:400: Request processed in 29us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.143985:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839563.144690:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788839563.144699:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060652160:12345-0@lo:400: 00000100:00100000:1.0:1788839563.144826:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060652160:12345-0@lo:400: Request processed in 129us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.144834:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788839563.144847:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788839563.144854:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060652672:12345-0@lo:400: 00000100:00100000:1.0:1788839563.144882:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060652672:12345-0@lo:400: Request processed in 29us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839563.144887:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1788839563.144913:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839563.144917:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839563.144956:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060652160:0@lo:400: 00000100:00100000:1.0:1788839563.144968:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060652672:0@lo:400: 00010000:00080000:1.0:1788839563.144983:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e42d80 x1875734060651264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788839563.145089:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e42300 x1875734060651136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839563.145110:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060651136:0@lo:13: 00000100:00100000:0.0:1788839563.145145:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060651648:0@lo:400: 00000100:00100000:1.0:1788839563.145683:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060651264:0@lo:13: 00010000:00080000:1.0:1788839563.145701:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ec000 x1875734060651776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839563.145711:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060651776:0@lo:13: 00010000:00080000:1.0:1788839563.145987:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443d8000 x1875734060652288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839563.146069:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060652288:0@lo:400: 00010000:00080000:1.0:1788839563.146084:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b3b80 x1875734060652800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839563.146093:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060652800:0@lo:400: 00000100:00100000:3.0:1788839563.147139:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060653056:0@lo:13: 00000100:00100000:3.0:1788839563.147218:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839563.148162:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060651520:0@lo:400: 00000100:00100000:3.0:1788839563.148178:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060652032:0@lo:400: 00010000:00080000:3.0:1788839563.148190:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aece00 x1875734060652544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839563.148201:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060652544:0@lo:400: 00000100:00100000:3.0:1788839563.148214:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060651904:0@lo:400: 00010000:00080000:3.0:1788839563.148225:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443dad80 x1875734060652416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839563.148233:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060652416:0@lo:400: 00010000:00080000:3.0:1788839563.148244:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b1500 x1875734060652928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839563.148251:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060652928:0@lo:400: 00000100:00100000:0.0:1788839563.151726:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653056 00000100:00100000:0.0:1788839563.151751:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653056 00000100:00100000:0.0:1788839563.151841:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839563.151852:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060653056:12345-0@lo:13: 00002000:00000024:0.0:1788839563.151880:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839563.151961:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060653056:12345-0@lo:13: Request processed in 113us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839563.151967:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788839563.152121:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed180 x1875734060653056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839579 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839563.152142:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060653056:0@lo:13: 00000100:00100000:0.0:1788839563.647361:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060653184:0@lo:41: 00000100:00100000:0.0:1788839563.647441:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839563.647591:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653184 00000100:00100000:2.0:1788839563.647620:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653184 00000100:00100000:2.0:1788839563.647685:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839563.647694:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060653184:12345-0@lo:41: 00000004:00000024:2.0:1788839563.647734:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788839563.657336:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060653184:12345-0@lo:41: Request processed in 9633us (9885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839563.657351:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839563.658755:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060653184:0@lo:41: 00010000:00010000:1.0:1788839564.097122:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839564.170163:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000001:00100000:0.0:1788839564.170471:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000001:00100000:2.0:1788839564.171542:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000100:00100000:0.0:1788839564.457612:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839564.457655:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839564.457678:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839564.457702:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839564.457736:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839564.457766:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116096 00000100:00100000:0.0:1788839564.457792:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116096 00000100:00100000:0.0:1788839564.457842:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115968 00000100:00100000:0.0:1788839564.457844:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115968 00000100:00100000:1.0:1788839564.458071:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115584 00000100:00100000:1.0:1788839564.458076:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115584 00000100:00100000:1.0:1788839564.458105:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:1.0:1788839564.458114:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050115584:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839564.458176:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050115584:12345-192.168.203.52@tcp:400: Request processed in 63us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839564.458183:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:1.0:1788839564.458213:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115840 00000100:00100000:1.0:1788839564.458217:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115840 00000100:00100000:1.0:1788839564.458240:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050115712 00000100:00100000:1.0:1788839564.458243:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050115712 00000100:00100000:1.0:1788839564.458259:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788839564.458265:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050115840:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839564.458291:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050115840:12345-192.168.203.52@tcp:400: Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839564.458297:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788839564.458307:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788839564.458312:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050115712:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839564.458339:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050115712:12345-192.168.203.52@tcp:400: Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839564.458345:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:1.0:1788839564.458361:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839564.458364:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839564.458366:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839564.458368:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839564.459376:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788839564.459393:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116096:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788839564.459527:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116096:12345-192.168.203.52@tcp:400: Request processed in 140us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839564.459534:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788839564.459562:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788839564.459569:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050115968:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1788839564.459601:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050115968:12345-192.168.203.52@tcp:400: Request processed in 32us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839564.459614:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000001:02000400:3.0:1788839564.555257:0:10154:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788839565.119800:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788839565.186347:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000100:00100000:2.0:1788839565.694968:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060653312:0@lo:41: 00000100:00100000:2.0:1788839565.695046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839565.695228:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653312 00000100:00100000:2.0:1788839565.695236:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653312 00000100:00100000:2.0:1788839565.695294:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788839565.695304:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060653312:12345-0@lo:41: 00000004:00000024:2.0:1788839565.695336:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839565.695396:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060653312:12345-0@lo:41: Request processed in 93us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839565.695404:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788839565.695451:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060653312:0@lo:41: 00010000:00010000:2.0:1788839566.150514:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839567.167059:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839568.195891:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839568.256242:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060653440:0@lo:400: 00000100:00100000:3.0:1788839568.258367:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258428:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060653952:0@lo:400: 00000100:00100000:3.0:1788839568.258459:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258476:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060654464:0@lo:400: 00000100:00100000:3.0:1788839568.258499:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258517:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060654976:0@lo:400: 00000100:00100000:3.0:1788839568.258536:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258561:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788839568.258567:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060653568:0@lo:400: 00000100:00100000:3.0:1788839568.258607:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258626:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060654080:0@lo:400: 00000100:00100000:3.0:1788839568.258645:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258661:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060654592:0@lo:400: 00000100:00100000:3.0:1788839568.258680:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258716:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060653696:0@lo:400: 00000100:00100000:3.0:1788839568.258738:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258753:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060654208:0@lo:400: 00000100:00100000:3.0:1788839568.258796:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258810:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060654720:0@lo:400: 00000100:00100000:3.0:1788839568.258826:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258838:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788839568.258843:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060653824:0@lo:400: 00000100:00100000:3.0:1788839568.258858:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258866:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060654336:0@lo:400: 00000100:00100000:3.0:1788839568.258881:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258896:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060654848:0@lo:400: 00000100:00100000:3.0:1788839568.258911:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.258936:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654464 00000100:00100000:3.0:1788839568.258943:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654464 00000100:00100000:3.0:1788839568.258995:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654976 00000100:00100000:3.0:1788839568.258998:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654976 00000100:00100000:3.0:1788839568.259010:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654336 00000100:00100000:3.0:1788839568.259012:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654336 00000100:00100000:3.0:1788839568.259024:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654848 00000100:00100000:3.0:1788839568.259026:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654848 00000100:00100000:3.0:1788839568.259040:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839568.259048:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060654464:12345-0@lo:400: 00000100:00100000:3.0:1788839568.259098:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060654464:12345-0@lo:400: Request processed in 50us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839568.259105:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839568.259122:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839568.259128:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060654976:12345-0@lo:400: 00000100:00100000:3.0:1788839568.259156:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060654976:12345-0@lo:400: Request processed in 28us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839568.259171:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839568.259183:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839568.259189:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060654336:12345-0@lo:400: 00000100:00100000:3.0:1788839568.259223:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060654336:12345-0@lo:400: Request processed in 34us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839568.259228:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839568.259239:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839568.259245:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060654848:12345-0@lo:400: 00000100:00100000:3.0:1788839568.259270:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060654848:12345-0@lo:400: Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839568.259275:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788839568.259320:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5c380 x1875734060654336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839568.259334:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060654336:0@lo:400: 00010000:00080000:3.0:1788839568.259346:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647979500 x1875734060654848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839568.259354:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060654848:0@lo:400: 00010000:00080000:3.0:1788839568.259383:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5ed80 x1875734060654464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839568.259392:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060654464:0@lo:400: 00010000:00080000:3.0:1788839568.259401:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647979c00 x1875734060654976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839568.259408:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060654976:0@lo:400: 00000100:00100000:2.0:1788839568.259745:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653952 00000100:00100000:2.0:1788839568.259750:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653952 00000100:00100000:2.0:1788839568.259791:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653696 00000100:00100000:2.0:1788839568.259795:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653696 00000100:00100000:2.0:1788839568.259811:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839568.259817:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060653952:12345-0@lo:400: 00000100:00100000:2.0:1788839568.259857:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060653952:12345-0@lo:400: Request processed in 40us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.259863:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839568.259875:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839568.259882:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060653696:12345-0@lo:400: 00000100:00100000:2.0:1788839568.259915:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060653696:12345-0@lo:400: Request processed in 34us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.259921:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839568.260012:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060653696:0@lo:400: 00000100:00100000:2.0:1788839568.260039:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060653952:0@lo:400: 00000100:00100000:2.0:1788839568.260046:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839568.260055:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060655104:0@lo:13: 00000100:00100000:2.0:1788839568.260083:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.260111:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060655104 00000100:00100000:2.0:1788839568.260115:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060655104 00000100:00100000:2.0:1788839568.260140:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839568.260146:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060655104:12345-0@lo:13: 00002000:00000024:2.0:1788839568.260169:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839568.260202:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060655104:12345-0@lo:13: Request processed in 56us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.260217:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788839568.260243:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a33100 x1875734060655104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839568.260257:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060655104:0@lo:13: 00000100:00100000:2.0:1788839568.260844:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653568 00000100:00100000:2.0:1788839568.260849:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653568 00000100:00100000:2.0:1788839568.260870:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654080 00000100:00100000:2.0:1788839568.260872:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654080 00000100:00100000:2.0:1788839568.260883:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654592 00000100:00100000:2.0:1788839568.260885:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654592 00000100:00100000:2.0:1788839568.260895:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654208 00000100:00100000:2.0:1788839568.260897:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654208 00000100:00100000:2.0:1788839568.260906:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060654720 00000100:00100000:2.0:1788839568.260908:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060654720 00000100:00100000:2.0:1788839568.260917:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653824 00000100:00100000:2.0:1788839568.260919:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653824 00000100:00100000:2.0:1788839568.260929:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788839568.260935:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060653568:12345-0@lo:400: 00000100:00100000:2.0:1788839568.260974:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060653568:12345-0@lo:400: Request processed in 39us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.260980:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788839568.260991:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839568.261351:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060654080:12345-0@lo:400: 00000100:00100000:2.0:1788839568.261382:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060654080:12345-0@lo:400: Request processed in 387us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.261389:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839568.261401:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839568.261406:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060654592:12345-0@lo:400: 00000100:00100000:2.0:1788839568.261436:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060654592:12345-0@lo:400: Request processed in 30us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.261442:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839568.261452:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788839568.261457:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060654208:12345-0@lo:400: 00000100:00100000:2.0:1788839568.261488:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060654208:12345-0@lo:400: Request processed in 31us (2692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.261494:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788839568.261505:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788839568.261511:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060654720:12345-0@lo:400: 00000100:00100000:2.0:1788839568.261537:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060654720:12345-0@lo:400: Request processed in 27us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.261542:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788839568.261552:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788839568.261558:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060653824:12345-0@lo:400: 00000100:00100000:2.0:1788839568.261594:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060653824:12345-0@lo:400: Request processed in 37us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.261599:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788839568.261626:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060653440 00000100:00100000:2.0:1788839568.261630:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060653440 00000100:00100000:2.0:1788839568.261657:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788839568.261663:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060653440:12345-0@lo:400: 00000100:00100000:2.0:1788839568.261693:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060653440:12345-0@lo:400: Request processed in 30us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.261698:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788839568.261738:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060653824:0@lo:400: 00010000:00080000:2.0:1788839568.261759:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5c700 x1875734060654208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839568.261786:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060654208:0@lo:400: 00010000:00080000:2.0:1788839568.261795:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5f100 x1875734060654720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839568.261802:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060654720:0@lo:400: 00000100:00100000:2.0:1788839568.261834:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060653568:0@lo:400: 00000100:00100000:2.0:1788839568.261844:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060654080:0@lo:400: 00000100:00100000:2.0:1788839568.261853:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060654592:0@lo:400: 00000100:00100000:2.0:1788839568.261862:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060653440:0@lo:400: 00000100:00080000:1.0:1788839568.262490:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839568.262496:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839568.262498:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839568.262501:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839568.262625:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060655232:0@lo:13: 00000100:00100000:1.0:1788839568.262664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839568.262701:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060655232 00000100:00100000:1.0:1788839568.262706:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060655232 00000100:00100000:1.0:1788839568.262735:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839568.262743:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060655232:12345-0@lo:13: 00002000:00000024:1.0:1788839568.262763:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839568.265193:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839568.265216:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060655488:0@lo:13: 00000100:00100000:2.0:1788839568.265299:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839568.266207:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060655232:12345-0@lo:13: Request processed in 3462us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839568.266219:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839568.266250:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060655488 00000100:00100000:1.0:1788839568.266258:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060655488 00000100:00100000:1.0:1788839568.266289:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839568.266296:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060655488:12345-0@lo:13: 00002000:00000024:1.0:1788839568.266319:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839568.266356:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060655488:12345-0@lo:13: Request processed in 61us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839568.266362:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788839568.266392:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060655360:0@lo:13: 00000100:00100000:1.0:1788839568.266424:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788839568.266446:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a33100 x1875734060655488/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839568.266470:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060655488:0@lo:13: 00000100:00100000:1.0:1788839568.266480:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060655360 00000100:00100000:1.0:1788839568.266486:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060655360 00000100:00100000:1.0:1788839568.266506:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788839568.266512:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060655360:12345-0@lo:13: 00002000:00000024:1.0:1788839568.266522:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839568.266563:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060655360:12345-0@lo:13: Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839568.266570:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788839568.266616:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eef100 x1875734060655232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788839568.266634:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647979c00 x1875734060655360/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839568.266634:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060655232:0@lo:13: 00000100:00100000:2.0:1788839568.266656:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060655360:0@lo:13: 00000020:00000080:0.0:1788839568.355348:0:10301:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcca6bbf00 20000000:00000080:0.0:1788839568.355367:0:10301:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab647832400 uarg=0000000000000000 20000000:01000000:0.0:1788839568.355417:0:10301:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788839568.355420:0:10301:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788839568.355423:0:10301:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788839568.355427:0:10301:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788839568.355432:0:10301:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788839568.355498:0:10301:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788839568.355501:0:10301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788839568.369083:0:10302:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788839568.375897:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788839568.375929:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788839568.375941:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788839568.375969:0:10301:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788839568.375972:0:10301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839568.376565:0:10303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788839568.376945:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788839568.376974:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788839568.376990:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788839568.377000:0:10301:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788839568.377002:0:10301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839568.377758:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788839568.378007:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788839568.378034:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788839568.378051:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788839568.378065:0:10301:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788839568.378067:0:10301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839568.378516:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788839568.378676:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788839568.378698:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788839568.378713:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788839568.378723:0:10301:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788839568.378725:0:10301:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788839568.379330:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788839568.379492:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788839568.379515:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788839568.379529:0:10301:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1788839568.379543:0:10301:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788839568.379564:0:10301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379592:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729c4 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379602:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729ee expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379608:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a2d expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379627:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a3b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379634:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a49 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379641:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a65 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379649:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572a88 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379656:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572aab expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379663:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379672:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379679:0:10301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379687:0:10301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379726:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.379755:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 9 pid: 6481 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839568.380357:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060655616:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839568.380790:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.380801:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 9 pid: 6479 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.380813:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060655744:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839568.380860:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.380869:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 23 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.380878:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64797aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060655872:0@lo:104: 00000100:00100000:3.0:1788839568.380918:0:10301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839568.380957:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572aab expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.380966:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572aab expref: 23 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.380974:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64797a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656000:0@lo:104: 00000100:00100000:3.0:1788839568.380995:0:10301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839568.381025:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572a88 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381034:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572a88 expref: 23 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381043:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656128:0@lo:104: 00000100:00100000:3.0:1788839568.381076:0:10301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839568.381096:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572a65 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381104:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572a65 expref: 23 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381113:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656256:0@lo:104: 00000100:00100000:3.0:1788839568.381137:0:10301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839568.381155:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572a49 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381163:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572a49 expref: 23 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381171:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656384:0@lo:104: 00010000:00010000:3.0:1788839568.381194:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572a3b expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381201:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572a3b expref: 23 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381209:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656512:0@lo:104: 00010000:00010000:3.0:1788839568.381237:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572a2d expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381245:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572a2d expref: 23 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381253:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656640:0@lo:104: 00010000:00010000:3.0:1788839568.381302:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265729ee expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381310:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265729ee expref: 23 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381319:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656768:0@lo:104: 00010000:00010000:3.0:1788839568.381345:0:10301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265729c4 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.381353:0:10301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265729c4 expref: 23 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.381361:0:10301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656896:0@lo:104: 00000100:00100000:3.0:1788839568.381379:0:10301:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839568.382427:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788839568.382473:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.382495:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.382505:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.382512:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.382520:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.382529:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060655872 00000100:00100000:2.0:1788839568.382535:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060655872 00000100:00100000:2.0:1788839568.382587:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656000 00000100:00100000:2.0:1788839568.382591:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656000 00000100:00100000:2.0:1788839568.382603:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656128 00000100:00100000:2.0:1788839568.382606:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656128 00000100:00100000:2.0:1788839568.382615:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656256 00000100:00100000:2.0:1788839568.382618:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656256 00000100:00100000:2.0:1788839568.382642:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656384 00000100:00100000:2.0:1788839568.382645:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656384 00000100:00100000:2.0:1788839568.382655:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656512 00000100:00100000:2.0:1788839568.382657:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656512 00000100:00100000:2.0:1788839568.382665:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656640 00000100:00100000:2.0:1788839568.382667:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656640 00000100:00100000:2.0:1788839568.382675:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656768 00000100:00100000:2.0:1788839568.382677:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656768 00000100:00100000:2.0:1788839568.382683:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060656896 00000100:00100000:2.0:1788839568.382686:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060656896 00000100:00100000:2.0:1788839568.382699:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839568.382708:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+11:10301:x1875734060655872:12345-0@lo:104: 00010000:00010000:2.0:1788839568.382731:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.382846:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839568.382852:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+11:10301:x1875734060655872:12345-0@lo:104: Request processed in 146us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.382859:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839568.382878:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839568.382884:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+10:10301:x1875734060656000:12345-0@lo:104: 00010000:00010000:2.0:1788839568.382892:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.382928:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839568.382933:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+10:10301:x1875734060656000:12345-0@lo:104: Request processed in 50us (1938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.382939:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839568.382951:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839568.382957:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+9:10301:x1875734060656128:12345-0@lo:104: 00010000:00010000:2.0:1788839568.382964:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.382991:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788839568.382996:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+9:10301:x1875734060656128:12345-0@lo:104: Request processed in 40us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383002:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839568.383014:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839568.383020:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+8:10301:x1875734060656256:12345-0@lo:104: 00010000:00010000:2.0:1788839568.383034:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383063:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788839568.383068:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b49450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+8:10301:x1875734060656256:12345-0@lo:104: Request processed in 49us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383074:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839568.383103:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839568.383110:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+7:10301:x1875734060656384:12345-0@lo:104: 00010000:00010000:2.0:1788839568.383117:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383142:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788839568.383148:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+7:10301:x1875734060656384:12345-0@lo:104: Request processed in 39us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383153:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839568.383163:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839568.383169:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+6:10301:x1875734060656512:12345-0@lo:104: 00010000:00010000:2.0:1788839568.383176:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383214:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788839568.383219:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+6:10301:x1875734060656512:12345-0@lo:104: Request processed in 51us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383225:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839568.383236:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839568.383242:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+5:10301:x1875734060656640:12345-0@lo:104: 00010000:00010000:2.0:1788839568.383256:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383282:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788839568.383287:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+5:10301:x1875734060656640:12345-0@lo:104: Request processed in 46us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383293:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839568.383306:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839568.383312:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:10301:x1875734060656768:12345-0@lo:104: 00010000:00010000:2.0:1788839568.383319:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383342:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788839568.383347:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:10301:x1875734060656768:12345-0@lo:104: Request processed in 36us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383352:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839568.383362:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839568.383368:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:10301:x1875734060656896:12345-0@lo:104: 00010000:00010000:2.0:1788839568.383375:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383399:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788839568.383403:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:10301:x1875734060656896:12345-0@lo:104: Request processed in 37us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.383408:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788839568.383426:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788839568.383431:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383443:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383448:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383456:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383463:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383469:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383499:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383505:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383519:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383526:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647842800/0xad5b343a26572ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572adc expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383538:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788839568.383541:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383546:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413ca800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383548:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383564:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383570:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383575:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383622:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383627:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383642:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383648:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca800/0xad5b343a26572aab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572ab2 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383659:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788839568.383662:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383667:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740030000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383670:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383676:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383682:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383692:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383705:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383710:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383715:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383720:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740030000/0xad5b343a26572a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a96 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383730:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788839568.383733:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383738:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cb400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383742:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383748:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383753:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383758:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383766:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383793:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383804:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383810:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb400/0xad5b343a26572a65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a6c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383818:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788839568.383821:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383826:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cae00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383829:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383835:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383840:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383845:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383855:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383861:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383864:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383869:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cae00/0xad5b343a26572a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a50 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383876:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788839568.383884:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383889:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413ca600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383892:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383897:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383902:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383907:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383918:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383923:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383927:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383932:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413ca600/0xad5b343a26572a3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a42 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383941:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788839568.383944:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383948:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.383951:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383966:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.383972:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.383977:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.383988:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.383992:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.383996:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384002:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7c00/0xad5b343a26572a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572a34 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384010:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839568.384013:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384017:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.384020:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384026:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.384032:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.384043:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.384056:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384061:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.384065:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384071:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7e00/0xad5b343a265729ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729f5 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384080:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839568.384083:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384088:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839568.384090:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384096:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839568.384102:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839568.384107:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788839568.384118:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384123:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839568.384134:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384140:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a265729c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729cb expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.384153:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839568.384155:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839568.384157:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839568.384166:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839568.386342:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64797aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060655872:0@lo:104: 00000100:00100000:3.0:1788839568.386358:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64797a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656000:0@lo:104: 00000100:00100000:3.0:1788839568.386367:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656128:0@lo:104: 00000100:00100000:3.0:1788839568.386376:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656256:0@lo:104: 00000100:00100000:3.0:1788839568.386385:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656384:0@lo:104: 00000100:00100000:3.0:1788839568.386393:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656512:0@lo:104: 00000100:00100000:3.0:1788839568.386401:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656640:0@lo:104: 00000100:00100000:3.0:1788839568.386408:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656768:0@lo:104: 00000100:00100000:3.0:1788839568.386415:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060656896:0@lo:104: 00000100:00100000:3.0:1788839568.387407:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657280:0@lo:103: 00000100:00100000:3.0:1788839568.387489:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.387559:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657792:0@lo:103: 00000100:00100000:1.0:1788839568.387595:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657280 00000100:00100000:3.0:1788839568.387596:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839568.387605:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657280 00000100:00100000:3.0:1788839568.387626:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788839568.387636:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657152:0@lo:103: 00010000:00010000:1.0:1788839568.387645:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a88 expref: 24 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.387660:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839568.387714:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060657408:0@lo:103: 00000100:00100000:3.0:1788839568.388656:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657664:0@lo:103: 00000100:00100000:3.0:1788839568.388688:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.390803:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060657024:0@lo:103: 00000100:00100000:1.0:1788839568.392837:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657792 00000100:00100000:1.0:1788839568.392852:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657792 00010000:00010000:1.0:1788839568.392907:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a2d expref: 25 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839568.392952:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657152 00000100:00100000:1.0:1788839568.392956:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657152 00010000:00010000:1.0:1788839568.392970:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572aab expref: 26 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839568.392981:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657664 00000100:00100000:1.0:1788839568.392983:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657664 00010000:00010000:1.0:1788839568.392993:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a3b expref: 27 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839568.393005:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839568.393012:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+27:3617:x1875734060657280:12345-0@lo:103: 00010000:00010000:1.0:1788839568.393025:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839568.393030:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a88 expref: 27 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839568.393039:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572a88 expref: 27 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839568.393056:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740030a00/0xad5b343a26572a96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572a88 expref: 27 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839568.393074:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.393337:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839568.393351:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+26:3617:x1875734060657792:12345-0@lo:103: 00010000:00010000:0.0:1788839568.393369:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.393376:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a2d expref: 26 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.393386:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572a2d expref: 26 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.393397:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de7800/0xad5b343a26572a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572a2d expref: 26 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.393406:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839568.401091:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788839568.401124:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788839568.401828:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+25:3617:x1875734060657792:12345-0@lo:103: Request processed in 8477us (14226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.401840:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839568.401870:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839568.402062:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060657152:12345-0@lo:103: 00010000:00010000:0.0:1788839568.402082:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.402091:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572aab expref: 24 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402104:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572aab expref: 24 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402124:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843e00/0xad5b343a26572ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572aab expref: 24 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402162:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.402197:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+23:3617:x1875734060657152:12345-0@lo:103: Request processed in 143us (14537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.402203:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839568.402217:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839568.402224:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+22:3617:x1875734060657664:12345-0@lo:103: 00010000:00010000:0.0:1788839568.402231:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.402307:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a3b expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402317:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572a3b expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402328:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031200/0xad5b343a26572a42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572a3b expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402339:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.402363:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060657664:12345-0@lo:103: Request processed in 141us (13675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.402370:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839568.402406:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839568.402520:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060657920:0@lo:103: 00000100:00100000:0.0:1788839568.402557:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839568.402596:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657408 00000100:00100000:0.0:1788839568.402604:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657408 00010000:00010000:0.0:1788839568.402629:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a65 expref: 21 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839568.402658:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657920 00000100:00100000:0.0:1788839568.402662:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657920 00010000:00010000:0.0:1788839568.402677:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265729ee expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839568.402692:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839568.402699:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+22:3614:x1875734060657408:12345-0@lo:103: 00010000:00010000:0.0:1788839568.402708:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.402713:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a65 expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402721:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572a65 expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.402732:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6600/0xad5b343a26572a6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572a65 expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839568.402743:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839568.402752:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839568.402791:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060657536:0@lo:103: 00000100:00100000:0.0:1788839568.402808:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3614:x1875734060657408:12345-0@lo:103: Request processed in 108us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.402815:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839568.402826:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839568.402831:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657024 00000100:00100000:0.0:1788839568.402837:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657024 00000100:00100000:2.0:1788839568.402843:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060658048:0@lo:103: 00010000:00010000:0.0:1788839568.402852:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 21 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839568.402866:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060657536 00000100:00100000:2.0:1788839568.402871:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839568.402936:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658048 00000100:00100000:2.0:1788839568.402940:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658048 00010000:00010000:2.0:1788839568.402956:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265729c4 expref: 22 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839568.402975:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839568.402981:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+22:3614:x1875734060657920:12345-0@lo:103: 00010000:00010000:2.0:1788839568.402989:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839568.402993:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265729ee expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.403013:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265729ee expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.403024:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6800/0xad5b343a265729f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265729ee expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.403034:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.403047:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060657536 00000100:00100000:2.0:1788839568.403061:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+22:3614:x1875734060657920:12345-0@lo:103: Request processed in 80us (503us total) trans 0 rc 0/0 00010000:00010000:0.0:1788839568.403068:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a49 expref: 22 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839568.403070:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839568.403088:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839568.403095:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1788839568.403097:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+21:3615:x1875734060657024:12345-0@lo:103: 00010000:00010000:2.0:1788839568.403108:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788839568.403109:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788839568.403116:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 21 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839568.403122:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3615:x1875734060658048:12345-0@lo:103: 00010000:00010000:2.0:1788839568.403133:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 21 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.403134:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.403142:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265729c4 expref: 21 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.403150:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843800/0xad5b343a26572adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572ad5 expref: 21 pid: 6480 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.403155:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265729c4 expref: 21 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839568.403165:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839568.403170:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553800/0xad5b343a265729cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265729c4 expref: 20 pid: 6481 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.403182:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.403215:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+19:3615:x1875734060658048:12345-0@lo:103: Request processed in 98us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.403221:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839568.403239:0:8419:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788839568.403246:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839568.403251:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+18:3615:x1875734060657536:12345-0@lo:103: 00010000:00010000:0.0:1788839568.403258:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.403262:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572a49 expref: 18 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.403270:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572a49 expref: 18 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.403281:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cb800/0xad5b343a26572a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572a49 expref: 18 pid: 6479 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.403298:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.403321:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+17:3615:x1875734060657536:12345-0@lo:103: Request processed in 70us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.403327:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839568.403362:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64797b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060657536:0@lo:103: 00000100:00100000:0.0:1788839568.403372:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060658048:0@lo:103: 00000100:00100000:0.0:1788839568.403399:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64797bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060657408:0@lo:103: 00000100:00100000:0.0:1788839568.403406:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060657920:0@lo:103: 00000100:00100000:1.0:1788839568.403665:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+16:3617:x1875734060657280:12345-0@lo:103: Request processed in 10651us (16174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839568.403674:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839568.403817:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+15:3615:x1875734060657024:12345-0@lo:103: Request processed in 721us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839568.403824:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839568.405756:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839568.405813:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839568.406086:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060657024:0@lo:103: 00000100:00100000:0.0:1788839568.406125:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116224 00000100:00100000:0.0:1788839568.406131:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116224 00010000:00010000:0.0:1788839568.406166:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 10 pid: 6479 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839568.406204:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116352 00000100:00100000:0.0:1788839568.406207:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116352 00010000:00010000:0.0:1788839568.406218:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 11 pid: 6481 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839568.406237:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788839568.406245:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050116224:12345-192.168.203.52@tcp:103: 00010000:00010000:0.0:1788839568.406258:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.406263:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 11 pid: 6479 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406283:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 11 pid: 6479 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406302:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.406352:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050116224:12345-192.168.203.52@tcp:103: Request processed in 108us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.406360:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788839568.406503:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1788839568.406509:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050116352:12345-192.168.203.52@tcp:103: 00010000:00010000:0.0:1788839568.406517:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839568.406522:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 10 pid: 6481 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406532:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 10 pid: 6481 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406546:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406554:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406569:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406576:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406591:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406603:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406610:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839568.406614:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406622:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406631:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839568.406641:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839568.406661:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050116352:12345-192.168.203.52@tcp:103: Request processed in 151us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839568.406668:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788839568.409199:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657664:0@lo:103: 00000100:00100000:3.0:1788839568.409215:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657280:0@lo:103: 00000100:00100000:3.0:1788839568.409224:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657792:0@lo:103: 00000100:00100000:3.0:1788839568.409269:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060657152:0@lo:103: 00010000:00010000:3.0:1788839568.409327:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842000/0xad5b343a26572af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746bf expref: 9 pid: 6481 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.409678:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060655616:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839568.409695:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553200/0xad5b343a26572aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746b8 expref: 8 pid: 6479 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.409707:0:10301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10301:1875734060655744:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839568.409749:0:10301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.409758:0:10301:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.409764:0:10301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839568.409814:0:10301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843000/0xad5b343a26572b30 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839568.767094:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839568.767124:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060658176:0@lo:41: 00000100:00100000:3.0:1788839568.767199:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839568.768606:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658176 00000100:00100000:3.0:1788839568.768621:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658176 00000100:00100000:1.0:1788839568.768923:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839568.768935:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060658176:12345-0@lo:41: 00000004:00000024:1.0:1788839568.768992:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839568.769091:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060658176:12345-0@lo:41: Request processed in 157us (1890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839568.769098:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788839568.769237:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060658176:0@lo:41: 00010000:00010000:2.0:1788839569.215208:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839569.585256:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839569.585563:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839569.585671:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839569.585704:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839569.585736:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839569.585807:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116480 00000100:00100000:1.0:1788839569.585818:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116480 00000100:00100000:1.0:1788839569.585874:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1788839569.585884:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+8:2390:x1875734050116480:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839569.585961:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+8:2390:x1875734050116480:12345-192.168.203.52@tcp:400: Request processed in 78us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.585981:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1788839569.586038:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116608 00000100:00100000:1.0:1788839569.586042:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116608 00000100:00100000:1.0:1788839569.586079:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116736 00000100:00100000:1.0:1788839569.586082:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116736 00000100:00100000:1.0:1788839569.586102:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788839569.586108:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050116608:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839569.586156:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050116608:12345-192.168.203.52@tcp:400: Request processed in 47us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.586163:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788839569.586175:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:1.0:1788839569.586181:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116736:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1788839569.586204:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116736:12345-192.168.203.52@tcp:400: Request processed in 22us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.586210:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00080000:1.0:1788839569.586228:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839569.586248:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839569.588250:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116864 00000100:00100000:3.0:1788839569.588263:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116864 00000100:00080000:1.0:1788839569.588358:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839569.588752:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050116992 00000100:00100000:2.0:1788839569.588757:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050116992 00000100:00100000:2.0:1788839569.588851:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788839569.588860:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116864:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1788839569.588929:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116864:12345-192.168.203.52@tcp:400: Request processed in 71us (3367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.588936:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788839569.588953:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788839569.588959:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116992:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1788839569.589103:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050116992:12345-192.168.203.52@tcp:400: Request processed in 144us (3366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.589110:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00080000:1.0:1788839569.589817:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:2.0:1788839569.919338:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788839569.919346:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab646536000 from 48 10000000:01000000:2.0:1788839569.919352:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839569.919403:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.919414:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.919425:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839569.919451:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658304:0@lo:101: 00000100:00100000:2.0:1788839569.919533:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.919624:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.919797:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658304 00000100:00100000:1.0:1788839569.919805:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658304 00000100:00100000:1.0:1788839569.919862:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788839569.919871:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+15:6483:x1875734060658304:12345-0@lo:101: 00010000:00010000:1.0:1788839569.919886:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839569.919901:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552600/0xad5b343a26572b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b37 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.919924:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552600/0xad5b343a26572b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b37 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.919935:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552600/0xad5b343a26572b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b37 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.919944:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552600, rc 0) 00000100:00100000:1.0:1788839569.921226:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060658304:12345-0@lo:101: Request processed in 1341us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.921242:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788839569.923795:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658304:0@lo:101: 00010000:00010000:3.0:1788839569.923827:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.923840:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839569.923930:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658432:0@lo:501: 00000100:00100000:3.0:1788839569.932590:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.932666:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.933142:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658432 00000100:00100000:1.0:1788839569.933152:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658432 00000100:00100000:1.0:1788839569.933220:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788839569.933230:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060658432:12345-0@lo:501: 00000100:00100000:1.0:1788839569.933685:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060658432:12345-0@lo:501: Request processed in 456us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.933694:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788839569.933946:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658432:0@lo:501: 00000100:00100000:3.0:1788839569.934047:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658560:0@lo:503: 00000100:00100000:3.0:1788839569.934104:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.934205:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.934305:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658560 00000100:00100000:1.0:1788839569.934317:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658560 00000100:00100000:1.0:1788839569.934396:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788839569.934406:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060658560:12345-0@lo:503: 00000100:00100000:1.0:1788839569.934547:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060658560:12345-0@lo:503: Request processed in 143us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.934554:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788839569.934651:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658560:0@lo:503: 00000100:00100000:0.0:1788839569.935204:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10319:1875734060658688:0@lo:502: 00000100:00100000:0.0:1788839569.936719:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.936858:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658688 00000100:00100000:2.0:1788839569.936866:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658688 00000100:00100000:0.0:1788839569.936910:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.936914:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788839569.936923:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:10319:x1875734060658688:12345-0@lo:502: 00000100:00100000:2.0:1788839569.937089:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:10319:x1875734060658688:12345-0@lo:502: Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.937098:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788839569.937453:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10319:1875734060658688:0@lo:502: 00000100:00100000:0.0:1788839569.937513:0:10319:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10319:1875734060658816:0@lo:502: 00000100:00100000:0.0:1788839569.937559:0:10319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.937588:0:10319:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.937641:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658816 00000100:00100000:1.0:1788839569.937645:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658816 00000100:00100000:1.0:1788839569.937681:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788839569.937688:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:10319:x1875734060658816:12345-0@lo:502: 00000100:00100000:1.0:1788839569.937793:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+16:10319:x1875734060658816:12345-0@lo:502: Request processed in 105us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.937799:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788839569.937876:0:10319:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10319:1875734060658816:0@lo:502: 00000040:00080000:2.0:1788839569.937895:0:10319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788839569.938064:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788839569.938088:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839569.938097:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.938106:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839569.938122:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788839569.938125:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788839569.938128:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788839569.938153:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.938161:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.938171:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839569.938184:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658944:0@lo:101: 00000100:00100000:3.0:1788839569.938220:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.938257:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.938393:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060658944 00000100:00100000:1.0:1788839569.938398:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060658944 00000100:00100000:1.0:1788839569.938433:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788839569.938440:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+16:6483:x1875734060658944:12345-0@lo:101: 00010000:00010000:1.0:1788839569.938450:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839569.938463:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552400/0xad5b343a26572b4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b45 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.938483:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552400/0xad5b343a26572b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b45 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.938492:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552400/0xad5b343a26572b4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b45 expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.938501:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552400, rc 0) 00000100:00100000:1.0:1788839569.938528:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060658944:12345-0@lo:101: Request processed in 89us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.938544:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788839569.938626:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060658944:0@lo:101: 00010000:00010000:3.0:1788839569.938639:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.938648:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839569.938703:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659072:0@lo:501: 00000100:00100000:3.0:1788839569.938725:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.938744:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.938883:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659072 00000100:00100000:0.0:1788839569.938887:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659072 00000100:00100000:0.0:1788839569.938917:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788839569.938923:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060659072:12345-0@lo:501: 00000100:00100000:0.0:1788839569.939080:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060659072:12345-0@lo:501: Request processed in 156us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.939087:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788839569.939310:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659072:0@lo:501: 00000100:00100000:2.0:1788839569.939341:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659200:0@lo:503: 00000100:00100000:2.0:1788839569.939379:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.939406:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.939445:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659200 00000100:00100000:0.0:1788839569.939449:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659200 00000100:00100000:0.0:1788839569.939503:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788839569.939510:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060659200:12345-0@lo:503: 00000100:00100000:0.0:1788839569.939591:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060659200:12345-0@lo:503: Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.939598:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788839569.939651:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659200:0@lo:503: 00000100:00100000:2.0:1788839569.942081:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10320:1875734060659328:0@lo:502: 00000100:00100000:2.0:1788839569.942182:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.942503:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.942576:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659328 00000100:00100000:1.0:1788839569.942584:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659328 00000100:00100000:1.0:1788839569.942626:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788839569.942634:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:10320:x1875734060659328:12345-0@lo:502: 00000100:00100000:1.0:1788839569.942762:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+17:10320:x1875734060659328:12345-0@lo:502: Request processed in 128us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.942788:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788839569.942905:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10320:1875734060659328:0@lo:502: 00000020:01000000:2.0:1788839569.942936:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839569.942945:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839569.942948:0:10320:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839569.942954:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788839569.942981:0:10320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10320:1875734060659456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.943026:0:10320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.943041:0:10320:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.943108:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659456 00000100:00100000:0.0:1788839569.943112:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659456 00000100:00100000:0.0:1788839569.943213:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788839569.943219:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:10320:x1875734060659456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839569.943304:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:10320:x1875734060659456:12345-0@lo:502:llog_process_th.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.943310:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788839569.943430:0:10320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10320:1875734060659456:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839569.943456:0:10320:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839569.943461:0:10320:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839569.943464:0:10320:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839569.943468:0:10320:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1788839569.943688:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788839569.943712:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788839569.943723:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.943745:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839569.943756:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788839569.943758:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab777b41000 from 48 10000000:01000000:0.0:1788839569.943761:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788839569.943818:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.943827:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.943836:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839569.943851:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.943882:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.943902:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.943975:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659584 00000100:00100000:2.0:1788839569.943980:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659584 00000100:00100000:2.0:1788839569.944021:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788839569.944029:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+17:6483:x1875734060659584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839569.944039:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839569.944051:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842800/0xad5b343a26572b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b53 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.944072:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842800/0xad5b343a26572b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b53 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.944082:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842800/0xad5b343a26572b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b53 expref: 18 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.944090:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842800, rc 0) 00000100:00100000:2.0:1788839569.949352:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060659584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5196us (5340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.949368:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788839569.949546:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839569.949582:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.949595:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839569.949685:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.949740:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.949860:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839569.950083:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659712 00000100:00100000:3.0:1788839569.950091:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659712 00000100:00100000:1.0:1788839569.950198:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788839569.950210:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060659712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839569.950454:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060659712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.950462:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788839569.950546:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.950589:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.950628:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.950650:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.950698:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659840 00000100:00100000:2.0:1788839569.950702:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659840 00000100:00100000:2.0:1788839569.950730:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788839569.950737:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060659840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.950836:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060659840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.950852:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788839569.950963:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060659840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.951539:0:10321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10321:1875734060659968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839569.951590:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.951618:0:10321:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.951664:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060659968 00000100:00100000:2.0:1788839569.951669:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060659968 00000100:00100000:2.0:1788839569.951702:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788839569.951708:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:10321:x1875734060659968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.951820:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:10321:x1875734060659968:12345-0@lo:502:llog_process_th.0 Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.951828:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788839569.951935:0:10321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10321:1875734060659968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839569.951975:0:10321:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10321:1875734060660096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839569.952068:0:10321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.952092:0:10321:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.952216:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660096 00000100:00100000:2.0:1788839569.952221:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660096 00000100:00100000:2.0:1788839569.952344:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788839569.952352:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:10321:x1875734060660096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.952432:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+18:10321:x1875734060660096:12345-0@lo:502:llog_process_th.0 Request processed in 81us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.952439:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788839569.952605:0:10321:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10321:1875734060660096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788839569.952627:0:10321:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788839569.952863:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788839569.952884:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839569.952894:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.952904:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839569.952914:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788839569.952917:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788839569.952919:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788839569.952947:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.952961:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.952971:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839569.953001:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.953036:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.953057:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839569.953416:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660224 00000100:00100000:3.0:1788839569.953423:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660224 00000100:00100000:3.0:1788839569.953465:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788839569.953473:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+18:6483:x1875734060660224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839569.953484:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839569.953497:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6400/0xad5b343a26572b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b61 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.953521:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6400/0xad5b343a26572b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b61 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.953531:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6400/0xad5b343a26572b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b61 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.953539:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6400, rc 0) 00000100:00100000:3.0:1788839569.953591:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060660224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839569.953598:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788839569.953636:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839569.953650:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.953671:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839569.953728:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.953756:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.953803:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839569.953814:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660352 00000100:00100000:3.0:1788839569.953817:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660352 00000100:00100000:3.0:1788839569.953834:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788839569.953839:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060660352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.953943:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060660352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839569.953950:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788839569.953979:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.954104:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.954219:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.954233:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839569.954314:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660480 00000100:00100000:3.0:1788839569.954318:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660480 00000100:00100000:3.0:1788839569.954337:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788839569.954342:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060660480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.954410:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060660480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839569.954416:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788839569.954461:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.954671:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10322:1875734060660608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839569.954703:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.954721:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660608 00000100:00100000:3.0:1788839569.954724:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660608 00000100:00100000:3.0:1788839569.954740:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788839569.954746:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:10322:x1875734060660608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.956684:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839569.957043:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+19:10322:x1875734060660608:12345-0@lo:502:llog_process_th.0 Request processed in 2292us (2334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839569.957055:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788839569.957453:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10322:1875734060660608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839569.957488:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839569.957500:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839569.957502:0:10322:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839569.957508:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788839569.957549:0:10322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10322:1875734060660736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.957615:0:10322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.957678:0:10322:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.957711:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660736 00000100:00100000:0.0:1788839569.957717:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660736 00000100:00100000:0.0:1788839569.957833:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788839569.957842:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+19:10322:x1875734060660736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839569.957937:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+19:10322:x1875734060660736:12345-0@lo:502:llog_process_th.0 Request processed in 97us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.957944:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788839569.958104:0:10322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10322:1875734060660736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839569.958140:0:10322:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839569.958145:0:10322:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839569.958147:0:10322:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839569.958150:0:10322:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1788839569.958490:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788839569.958512:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788839569.958522:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.958533:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839569.958543:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788839569.958546:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab74434b000 from 48 10000000:01000000:3.0:1788839569.958549:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839569.958584:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.958592:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.958601:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839569.958624:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.958657:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.958729:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.958798:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660864 00000100:00100000:0.0:1788839569.958805:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660864 00000100:00100000:0.0:1788839569.958846:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788839569.958853:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+19:6483:x1875734060660864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839569.958863:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839569.958876:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740031a00/0xad5b343a26572b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b6f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.958897:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740031a00/0xad5b343a26572b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b6f expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.958907:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740031a00/0xad5b343a26572b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b6f expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839569.958914:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740031a00, rc 0) 00000100:00100000:0.0:1788839569.958953:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060660864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.958959:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788839569.959145:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839569.959158:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.959176:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839569.959225:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.961159:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.961210:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.962183:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060660992 00000100:00100000:0.0:1788839569.962196:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060660992 00000100:00100000:0.0:1788839569.962505:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788839569.962517:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060660992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.962705:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060660992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 190us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.962713:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788839569.962927:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060660992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.962986:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.963164:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.963199:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839569.964098:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661120 00000100:00100000:0.0:1788839569.964107:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661120 00000100:00100000:0.0:1788839569.964166:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788839569.964176:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060661120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.964440:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060661120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839569.964455:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788839569.964576:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.965096:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10323:1875734060661248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.965159:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.965235:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1240 going to sleep for 11 seconds 00000100:00100000:3.0:1788839569.966525:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661248 00000100:00100000:3.0:1788839569.966536:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661248 00000100:00100000:2.0:1788839569.971065:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788839569.971081:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:10323:x1875734060661248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839569.971501:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:10323:x1875734060661248:12345-0@lo:502:llog_process_th.0 Request processed in 421us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.971510:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788839569.971640:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10323:1875734060661248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839569.971714:0:10323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10323:1875734060661376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839569.971755:0:10323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.971820:0:10323:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.972080:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661376 00000100:00100000:2.0:1788839569.972087:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661376 00000100:00100000:1.0:1788839569.972226:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788839569.972307:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:10323:x1875734060661376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839569.972400:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:10323:x1875734060661376:12345-0@lo:502:llog_process_th.0 Request processed in 164us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.972407:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788839569.972522:0:10323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10323:1875734060661376:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788839569.972545:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788839569.972754:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788839569.972815:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839569.972826:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.972844:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839569.972854:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788839569.972856:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788839569.972859:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788839569.972884:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.972891:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839569.972899:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839569.972915:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.972945:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839569.972963:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.973349:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661504 00000100:00100000:1.0:1788839569.973356:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661504 00000100:00100000:1.0:1788839569.973392:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788839569.973399:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060661504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839569.973411:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839569.973425:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552200/0xad5b343a26572b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b7d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.973461:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552200/0xad5b343a26572b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b7d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.973473:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552200/0xad5b343a26572b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b7d expref: 21 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839569.973481:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552200, rc 0) 00000100:00100000:1.0:1788839569.973524:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060661504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.973531:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788839569.974391:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839569.974411:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839569.974422:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839569.974497:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839569.974537:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839569.978404:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839569.983508:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661632 00000100:00100000:2.0:1788839569.983524:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661632 00000100:00100000:2.0:1788839569.983649:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788839569.983661:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060661632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839569.983875:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060661632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (9337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839569.983884:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788839569.984014:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.984068:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839569.984128:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839569.992001:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839569.995839:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661760 00000100:00100000:1.0:1788839569.995856:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661760 00000100:00100000:1.0:1788839569.995929:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788839569.995939:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060661760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839569.996129:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060661760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (12000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839569.996136:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788839569.999718:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060661760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.002028:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10324:1875734060661888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839570.002124:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.002165:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839570.002257:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060661888 00000100:00100000:1.0:1788839570.002264:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060661888 00000100:00100000:1.0:1788839570.002298:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788839570.002306:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:10324:x1875734060661888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839570.002424:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:10324:x1875734060661888:12345-0@lo:502:llog_process_th.0 Request processed in 117us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839570.002432:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788839570.002581:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10324:1875734060661888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839570.002609:0:10324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839570.002618:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839570.002621:0:10324:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788839570.002626:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788839570.002645:0:10324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10324:1875734060662016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839570.002673:0:10324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.002693:0:10324:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839570.002749:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662016 00000100:00100000:2.0:1788839570.002754:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662016 00000100:00100000:2.0:1788839570.002797:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788839570.002809:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:10324:x1875734060662016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839570.002878:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:10324:x1875734060662016:12345-0@lo:502:llog_process_th.0 Request processed in 69us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839570.002885:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788839570.003018:0:10324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10324:1875734060662016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839570.003034:0:10324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839570.003038:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839570.003039:0:10324:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788839570.003043:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788839570.006271:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788839570.006316:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788839570.006349:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.006361:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839570.006373:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788839570.006377:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab745341000 from 48 10000000:01000000:1.0:1788839570.006379:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788839570.006418:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.006426:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.006435:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839570.006462:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.006528:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839570.006596:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839570.006670:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662144 00000100:00100000:0.0:1788839570.006678:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662144 00000100:00100000:0.0:1788839570.006734:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788839570.006751:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060662144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839570.006765:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839570.006823:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740031200/0xad5b343a26572b92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b8b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.006848:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740031200/0xad5b343a26572b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b8b expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.006859:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740031200/0xad5b343a26572b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b8b expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.006867:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740031200, rc 0) 00000100:00100000:0.0:1788839570.006906:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060662144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839570.006914:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788839570.009593:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839570.009622:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.009635:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839570.009723:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.009833:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839570.009871:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839570.009947:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662272 00000100:00100000:0.0:1788839570.009954:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662272 00000100:00100000:0.0:1788839570.010001:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788839570.010010:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060662272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.010156:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060662272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839570.010163:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788839570.010357:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839570.010391:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839570.010829:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839570.010854:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938240 going to sleep for 11 seconds 00000100:00100000:1.0:1788839570.010877:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662400 00000100:00100000:1.0:1788839570.010883:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662400 00000100:00100000:1.0:1788839570.010919:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788839570.010927:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060662400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.011039:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060662400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839570.011047:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788839570.011964:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.017977:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10325:1875734060662528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839570.018220:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.018317:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839570.023444:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662528 00000100:00100000:1.0:1788839570.023462:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662528 00000100:00100000:1.0:1788839570.023542:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788839570.023552:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:10325:x1875734060662528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839570.023941:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:10325:x1875734060662528:12345-0@lo:502:llog_process_th.0 Request processed in 390us (5720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839570.023950:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788839570.024062:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10325:1875734060662528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839570.024142:0:10325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10325:1875734060662656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839570.024195:0:10325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.024234:0:10325:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839570.024278:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662656 00000100:00100000:2.0:1788839570.024284:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662656 00000100:00100000:2.0:1788839570.024320:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788839570.024328:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:10325:x1875734060662656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839570.024412:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:10325:x1875734060662656:12345-0@lo:502:llog_process_th.0 Request processed in 85us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839570.024419:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788839570.024530:0:10325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10325:1875734060662656:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788839570.024550:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788839570.024750:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788839570.024800:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839570.024811:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839570.024823:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839570.024834:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788839570.024837:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788839570.024840:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839570.024865:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839570.024873:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839570.024882:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839570.024896:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839570.024928:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839570.024955:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938240 going to sleep for 11 seconds 00000100:00100000:1.0:1788839570.025193:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662784 00000100:00100000:1.0:1788839570.025199:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662784 00000100:00100000:1.0:1788839570.025236:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788839570.025242:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060662784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839570.025252:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839570.025267:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553400/0xad5b343a26572ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572b99 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.025290:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553400/0xad5b343a26572ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572b99 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.025317:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553400/0xad5b343a26572ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572b99 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.025326:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553400, rc 0) 00000100:00100000:1.0:1788839570.025373:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060662784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839570.025380:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788839570.025458:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839570.025471:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.025479:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839570.025531:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.025558:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.025622:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839570.027535:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060662912 00000100:00100000:3.0:1788839570.027548:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060662912 00000100:00100000:3.0:1788839570.027612:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788839570.027634:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060662912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839570.029904:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060662912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2263us (4336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839570.029917:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788839570.029969:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060662912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.030026:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060663040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.030085:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839570.030123:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839570.030181:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663040 00000100:00100000:0.0:1788839570.030188:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663040 00000100:00100000:0.0:1788839570.030236:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788839570.030245:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060663040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.030344:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060663040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839570.030350:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788839570.030427:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060663040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.032110:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10326:1875734060663168:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839570.032199:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839570.032242:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839570.032305:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663168 00000100:00100000:3.0:1788839570.032312:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663168 00000100:00100000:3.0:1788839570.032358:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788839570.032368:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:10326:x1875734060663168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839570.032497:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:10326:x1875734060663168:12345-0@lo:502:llog_process_th.0 Request processed in 130us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839570.032505:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788839570.032631:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10326:1875734060663168:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839570.032663:0:10326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839570.032674:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839570.032677:0:10326:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788839570.032683:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788839570.032707:0:10326:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10326:1875734060663296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839570.032740:0:10326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839570.032762:0:10326:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0540 going to sleep for 11 seconds 00000100:00100000:2.0:1788839570.032854:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663296 00000100:00100000:2.0:1788839570.032858:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663296 00000100:00100000:2.0:1788839570.032885:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788839570.032892:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:10326:x1875734060663296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839570.032969:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:10326:x1875734060663296:12345-0@lo:502:llog_process_th.0 Request processed in 77us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839570.032976:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788839570.033120:0:10326:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10326:1875734060663296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839570.033142:0:10326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839570.033146:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839570.033148:0:10326:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788839570.033151:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788839570.033292:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788839570.033314:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788839570.033325:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.033347:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839570.033358:0:6483:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788839570.033360:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab7486e8000 from 1 10000000:01000000:0.0:1788839570.033363:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788839570.033387:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.033395:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.033403:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839570.033417:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060663424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.033446:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.033476:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839570.033514:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663424 00000100:00100000:1.0:1788839570.033520:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663424 00000100:00100000:1.0:1788839570.033552:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788839570.033558:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060663424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839570.033578:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839570.033590:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572ba7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.033611:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572ba7 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.033623:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572ba7 expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839570.033631:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552e00, rc 0) 00000100:00100000:1.0:1788839570.033672:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060663424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839570.033678:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788839570.033818:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060663424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839570.033831:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839570.033841:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839570.033889:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060663552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839570.033916:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839570.033943:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839570.034996:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663552 00000100:00100000:1.0:1788839570.035006:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663552 00000100:00100000:1.0:1788839570.035045:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788839570.035052:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060663552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839570.035161:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060663552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (1245us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839570.035182:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788839570.035260:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060663552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788839570.035297:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788839570.035306:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839570.035316:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839570.239053:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839570.815121:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839570.815149:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060663680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839570.815226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839570.815626:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663680 00000100:00100000:2.0:1788839570.815634:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663680 00000100:00100000:2.0:1788839570.815684:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788839570.815693:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060663680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839570.815725:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839570.815803:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060663680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839570.815836:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788839570.815952:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060663680:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839571.263029:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839572.287140:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839573.311512:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839573.375373:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060664192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839573.375462:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839573.375509:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664192 00000100:00100000:1.0:1788839573.375518:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664192 00000100:00080000:2.0:1788839573.375557:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839573.375587:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060664064:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.375621:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060663808:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839573.375625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.375649:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839573.375670:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060664704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839573.375695:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839573.376315:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663808 00000100:00100000:1.0:1788839573.376321:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663808 00000100:00100000:1.0:1788839573.376350:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664704 00000100:00100000:1.0:1788839573.376353:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664704 00000100:00100000:1.0:1788839573.376371:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839573.376381:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060664192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839573.376410:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839573.376457:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060664192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.376464:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788839573.376480:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839573.376487:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060663808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788839573.376501:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839573.376527:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060663808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.376533:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788839573.376554:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788839573.376560:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060664704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839573.376569:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839573.376593:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060664704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.376609:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788839573.376630:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839573.376655:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060663936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839573.376683:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788839573.376888:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b1500 x1875734060663808/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839573.376908:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060663808:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839573.376915:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060664320:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.377018:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.377039:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060664832:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.377061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.377083:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060665344:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.377102:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.377119:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060665856:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.377138:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.377201:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060663936 00000100:00100000:0.0:1788839573.377205:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060663936 00000100:00100000:0.0:1788839573.377235:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839573.377241:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060663936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839573.377252:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839573.377498:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060663936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 256us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.377505:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839573.377534:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664320 00000100:00100000:0.0:1788839573.377538:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664320 00000100:00100000:0.0:1788839573.377578:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788839573.377585:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060664320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.377632:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060664320:12345-0@lo:400:kworker.0 Request processed in 47us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.377639:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788839573.377654:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839573.377676:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060664320:0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.382813:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060664576:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.382863:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664832 00000100:00100000:0.0:1788839573.382872:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664832 00000100:00100000:0.0:1788839573.382946:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839573.382956:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060664832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.383047:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.383185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060664832:12345-0@lo:400:kworker.0 Request processed in 230us (6120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.383194:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839573.383223:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664064 00000100:00100000:0.0:1788839573.383228:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664064 00010000:00080000:3.0:1788839573.383232:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eef800 x1875734060664704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839573.383257:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788839573.383267:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060664064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839573.383281:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060664704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839573.383292:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060665216:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.383303:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060664064:12345-0@lo:400:kworker.0 Request processed in 36us (7676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.383310:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788839573.383352:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060664832:0@lo:400:kworker.0 00000100:00100000:3.0:1788839573.383382:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.383394:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664576 00000100:00100000:0.0:1788839573.383400:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664576 00000100:00100000:3.0:1788839573.383410:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060665728:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.383434:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788839573.383439:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.383446:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060664576:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788839573.383498:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af7100 x1875734060663936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839573.383512:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060663936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839573.383520:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060664448:0@lo:400:kworker.0 00010000:00080000:3.0:1788839573.383825:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eeca80 x1875734060664192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839573.383840:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060664192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839573.383868:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665344 00000100:00100000:3.0:1788839573.383873:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665344 00000100:00100000:3.0:1788839573.383901:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665856 00000100:00100000:3.0:1788839573.383904:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665856 00000100:00100000:3.0:1788839573.383916:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665216 00000100:00100000:3.0:1788839573.383919:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665216 00000100:00100000:3.0:1788839573.383929:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665728 00000100:00100000:3.0:1788839573.383931:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665728 00000100:00100000:3.0:1788839573.383944:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788839573.383950:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060665344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.387861:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060665088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.389219:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.389252:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060664576:12345-0@lo:400:kworker.0 Request processed in 5807us (6202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839573.389259:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060665600:0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.389280:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788839573.389298:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839573.389323:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839573.389339:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060664064:0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.389345:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060664960:0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.389352:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060664576:0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.389367:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839573.389397:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665088 00000100:00100000:2.0:1788839573.389400:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839573.389403:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665088 00000100:00100000:2.0:1788839573.389420:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060665856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.389452:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665600 00000100:00100000:0.0:1788839573.389455:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665600 00000100:00100000:0.0:1788839573.389473:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788839573.389479:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060665344:12345-0@lo:400:kworker.0 Request processed in 5524us (12371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839573.389481:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060665856:12345-0@lo:400:kworker.0 Request processed in 73us (12342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.389481:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060665088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839573.389495:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839573.389537:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060665088:12345-0@lo:400:kworker.0 Request processed in 56us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.389551:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788839573.389567:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788839573.389574:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060665600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.389600:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060665600:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.389605:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788839573.389622:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664448 00000100:00100000:0.0:1788839573.389626:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664448 00000100:00100000:0.0:1788839573.389644:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839573.389650:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060664448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839573.389681:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060664448:12345-0@lo:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.389688:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788839573.389704:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839573.391190:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060665472:0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.391238:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839573.391282:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060664448:0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.391311:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060664960 00000100:00100000:1.0:1788839573.391316:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060664960 00000100:00100000:1.0:1788839573.391351:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665472 00000100:00100000:1.0:1788839573.391354:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665472 00000100:00100000:1.0:1788839573.391371:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839573.391378:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060664960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.391598:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060664960:12345-0@lo:400:kworker.0 Request processed in 220us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.391606:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839573.391621:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839573.391640:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060665472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.391686:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060665472:12345-0@lo:400:kworker.0 Request processed in 46us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.391692:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788839573.391710:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839573.391728:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060664960:0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.391736:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060665472:0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.397244:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839573.397259:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839573.397299:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788839573.397315:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060665728:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788839573.397570:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e38000 x1875734060665344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839573.397587:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060665344:0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.399119:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060665216:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788839573.401232:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3ad80 x1875734060665856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839573.401252:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060665856:0@lo:400:kworker.0 00000100:00100000:3.0:1788839573.401386:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060665728:12345-0@lo:400:kworker.0 Request processed in 4076us (17947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839573.401416:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788839573.401480:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e38380 x1875734060665728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839573.401491:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060665728:0@lo:400:kworker.0 00010000:00080000:1.0:1788839573.405109:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e39c00 x1875734060665088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839573.405129:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060665088:0@lo:400:kworker.0 00010000:00080000:1.0:1788839573.405146:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3b100 x1875734060665600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839573.405154:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060665600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839573.405962:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060665216:12345-0@lo:400:kworker.0 Request processed in 8688us (22576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839573.405995:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788839573.406073:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3a300 x1875734060665216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839573.406097:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060665216:0@lo:400:kworker.0 00000100:00100000:1.0:1788839573.673364:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839573.673450:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117120 00000100:00100000:2.0:1788839573.673460:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117120 00000100:00100000:2.0:1788839573.673521:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:2.0:1788839573.673533:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+8:6165:x1875734050117120:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1788839573.673562:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839573.673581:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842600/0xad5b343a26572bb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7472f expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839573.673637:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842600/0xad5b343a26572bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7472f expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839573.673650:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842600/0xad5b343a26572bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7472f expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839573.673659:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842600, rc 0) 00000100:00100000:2.0:1788839573.673723:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050117120:12345-192.168.203.52@tcp:101: Request processed in 192us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839573.673730:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:0.0:1788839573.680049:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839573.680249:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117248 00000100:00100000:1.0:1788839573.680258:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117248 00000100:00100000:1.0:1788839573.680318:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:1.0:1788839573.680329:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050117248:12345-192.168.203.52@tcp:501: 00000100:00100000:1.0:1788839573.680495:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050117248:12345-192.168.203.52@tcp:501: Request processed in 167us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.680503:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:3.0:1788839573.689196:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839573.689471:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117376 00000100:00100000:0.0:1788839573.689482:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117376 00000100:00100000:0.0:1788839573.689554:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:0.0:1788839573.689566:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050117376:12345-192.168.203.52@tcp:503: 00000100:00100000:0.0:1788839573.689718:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050117376:12345-192.168.203.52@tcp:503: Request processed in 153us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.689727:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:3.0:1788839573.697048:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839573.697347:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117504 00000100:00100000:2.0:1788839573.697356:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117504 00000100:00100000:2.0:1788839573.697411:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:2.0:1788839573.697420:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+9:6663:x1875734050117504:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1788839573.697581:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+9:6663:x1875734050117504:12345-192.168.203.52@tcp:502: Request processed in 161us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839573.697588:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:2.0:1788839573.702616:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839573.705470:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117632 00000100:00100000:1.0:1788839573.705487:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117632 00000100:00100000:1.0:1788839573.705630:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:1.0:1788839573.705659:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+9:6663:x1875734050117632:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839573.705899:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+9:6663:x1875734050117632:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 242us (3294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839573.705907:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:3.0:1788839573.715479:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839573.720094:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117760 00000100:00100000:0.0:1788839573.720112:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117760 00000100:00100000:0.0:1788839573.720537:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:0.0:1788839573.720560:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050117760:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839573.720577:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839573.720596:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740030a00/0xad5b343a26572bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74736 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839573.720635:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740030a00/0xad5b343a26572bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74736 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839573.720646:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740030a00/0xad5b343a26572bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74736 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839573.720655:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740030a00, rc 0) 00000100:00100000:0.0:1788839573.720753:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050117760:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 197us (6075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839573.720761:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:3.0:1788839573.725837:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839573.725908:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050117888 00000100:00100000:1.0:1788839573.725919:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050117888 00000100:00100000:1.0:1788839573.725990:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:1.0:1788839573.726001:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050117888:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839573.726151:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050117888:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 152us (323us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839573.726160:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:0.0:1788839573.890232:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839573.890258:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060665984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839573.890334:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839573.890554:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060665984 00000100:00100000:2.0:1788839573.890563:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060665984 00000100:00100000:2.0:1788839573.890618:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788839573.890627:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060665984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839573.890660:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788839573.890725:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060665984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839573.890744:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788839573.890806:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060665984:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788839574.335065:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839574.697363:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839574.697398:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839574.697423:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839574.697439:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839574.697461:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839574.697486:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118144 00000100:00100000:3.0:1788839574.697495:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118144 00000100:00100000:3.0:1788839574.697558:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118272 00000100:00100000:3.0:1788839574.697562:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118272 00000100:00100000:3.0:1788839574.697586:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788839574.697595:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050118144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839574.697672:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050118144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839574.697679:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788839574.697707:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1788839574.697713:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050118272:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839574.697739:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050118272:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839574.697745:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00080000:3.0:1788839574.697762:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839574.697767:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839574.698173:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118400 00000100:00100000:0.0:1788839574.698179:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118400 00000100:00100000:0.0:1788839574.698231:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118528 00000100:00100000:0.0:1788839574.698234:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118528 00000100:00100000:0.0:1788839574.698256:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788839574.698264:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050118400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839574.698303:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050118400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839574.698309:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1788839574.698324:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1788839574.698331:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050118528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839574.698355:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050118528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839574.698360:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1788839574.698379:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118016 00000100:00100000:0.0:1788839574.698382:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118016 00000100:00100000:0.0:1788839574.698407:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:0.0:1788839574.698414:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2389:x1875734050118016:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839574.698437:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2389:x1875734050118016:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839574.698456:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00080000:3.0:1788839574.700093:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839574.700101:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788839575.020554:0:10364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecac5be40 20000000:00000080:1.0:1788839575.020575:0:10364:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab78190a400 uarg=0000000000000000 20000000:01000000:1.0:1788839575.020622:0:10364:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788839575.020629:0:10364:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788839575.020634:0:10364:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788839575.025720:0:10365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788839575.025968:0:10364:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788839575.038486:0:10364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788839575.038524:0:10364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788839575.038552:0:10364:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788839575.038568:0:10364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788839575.038588:0:10364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038608:0:10364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572858 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038617:0:10364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572866 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038640:0:10364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265728ba expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038648:0:10364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265729e0 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038659:0:10364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038668:0:10364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038707:0:10364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.038722:0:10364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 9 pid: 6479 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.038738:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666112:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839575.039822:0:10364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265729e0 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.039837:0:10364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265729e0 expref: 23 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.039850:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666240:0@lo:104: 00000100:00100000:1.0:1788839575.039900:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839575.039940:0:10364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a265728ba expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.039957:0:10364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a265728ba expref: 23 pid: 6479 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.039966:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666368:0@lo:104: 00000100:00100000:1.0:1788839575.039993:0:10364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839575.040019:0:10364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572866 expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.040027:0:10364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572866 expref: 23 pid: 6480 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.040034:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666496:0@lo:104: 00010000:00010000:1.0:1788839575.040057:0:10364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572858 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.040065:0:10364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572858 expref: 23 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.040073:0:10364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666624:0@lo:104: 00000100:00100000:1.0:1788839575.040092:0:10364:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839575.040609:0:6470:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788839575.040631:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839575.040646:0:6470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839575.040655:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060666240 00000100:00100000:2.0:1788839575.040661:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060666240 00000100:00100000:2.0:1788839575.040700:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060666368 00000100:00100000:2.0:1788839575.040704:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060666368 00000100:00100000:2.0:1788839575.040715:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060666496 00000100:00100000:2.0:1788839575.040717:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060666496 00000100:00100000:2.0:1788839575.040725:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060666624 00000100:00100000:2.0:1788839575.040727:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060666624 00000100:00100000:2.0:1788839575.040739:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788839575.040747:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+6:10364:x1875734060666240:12345-0@lo:104: 00010000:00010000:2.0:1788839575.040761:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.040847:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839575.040853:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+6:10364:x1875734060666240:12345-0@lo:104: Request processed in 108us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.040869:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788839575.040886:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839575.040892:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:10364:x1875734060666368:12345-0@lo:104: 00010000:00010000:2.0:1788839575.040900:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.040934:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839575.040939:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e548450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:10364:x1875734060666368:12345-0@lo:104: Request processed in 47us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.040945:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839575.040974:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839575.040980:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:10364:x1875734060666496:12345-0@lo:104: 00010000:00010000:2.0:1788839575.040987:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041014:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788839575.041019:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:10364:x1875734060666496:12345-0@lo:104: Request processed in 40us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.041023:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839575.041035:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839575.041041:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:10364:x1875734060666624:12345-0@lo:104: 00010000:00010000:2.0:1788839575.041047:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041070:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788839575.041075:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:10364:x1875734060666624:12345-0@lo:104: Request processed in 35us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.041086:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788839575.041104:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788839575.041110:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041117:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839575.041122:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041132:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839575.041139:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839575.041146:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839575.041177:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041183:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839575.041203:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041211:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a265729e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265729e7 expref: -99 pid: 9481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041235:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788839575.041240:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041256:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839575.041260:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041268:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839575.041274:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839575.041280:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839575.041294:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041299:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839575.041306:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041312:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a265728ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a265728c1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041322:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839575.041336:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041343:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839575.041346:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041364:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839575.041371:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839575.041377:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839575.041390:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041396:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839575.041414:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041421:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031600/0xad5b343a26572866 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657286d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041431:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839575.041434:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041440:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839575.041443:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041450:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839575.041456:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839575.041467:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788839575.041481:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041486:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839575.041492:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041499:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572858 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a2657285f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041512:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839575.041514:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839575.041515:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839575.041522:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839575.041545:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060667008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839575.041578:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839575.041602:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839575.041608:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060667136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839575.041628:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839575.041654:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667008 00000100:00100000:2.0:1788839575.041658:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667008 00010000:00010000:2.0:1788839575.041678:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572866 expref: 24 pid: 6480 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839575.041697:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667136 00000100:00100000:2.0:1788839575.041700:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667136 00010000:00010000:2.0:1788839575.041709:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572858 expref: 25 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839575.041740:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839575.041747:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+25:3614:x1875734060667008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839575.041758:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839575.041764:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572866 expref: 25 pid: 6480 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041797:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572866 expref: 25 pid: 6480 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041813:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839575.041841:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+25:3614:x1875734060667008:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.041847:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839575.041861:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839575.041867:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060667136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839575.041874:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839575.041878:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572858 expref: 24 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041885:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572858 expref: 24 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.041895:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839575.041916:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060667136:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.041922:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839575.041954:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060667136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839575.041971:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060667008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839575.042763:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060666752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839575.042834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839575.042864:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839575.042871:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060666880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839575.042893:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839575.042934:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eee680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666240:0@lo:104: 00000100:00100000:1.0:1788839575.042945:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666368:0@lo:104: 00010000:00010000:1.0:1788839575.042966:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cba00/0xad5b343a2657286d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572866 expref: 23 pid: 6480 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.042980:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666496:0@lo:104: 00010000:00010000:1.0:1788839575.042990:0:10364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cb600/0xad5b343a2657285f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572858 expref: 22 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839575.042998:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666624:0@lo:104: 00000100:00100000:0.0:1788839575.043238:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060666752 00000100:00100000:0.0:1788839575.043244:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060666752 00010000:00010000:0.0:1788839575.043270:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265729e0 expref: 22 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839575.043286:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060666880 00000100:00100000:0.0:1788839575.043289:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060666880 00010000:00010000:0.0:1788839575.043298:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265728ba expref: 23 pid: 6479 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839575.043310:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839575.043317:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+23:3616:x1875734060666752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839575.043327:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839575.043332:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265729e0 expref: 23 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839575.043342:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265729e0 expref: 23 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839575.043358:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413caa00/0xad5b343a265729e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265729e0 expref: 23 pid: 6481 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839575.043370:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839575.043406:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+22:3616:x1875734060666752:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839575.043414:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839575.043427:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788839575.043433:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3616:x1875734060666880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839575.043447:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839575.043452:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a265728ba expref: 21 pid: 6479 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839575.043461:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a265728ba expref: 21 pid: 6479 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839575.043471:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553a00/0xad5b343a265728c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a265728ba expref: 21 pid: 6479 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839575.043481:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839575.043501:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+20:3616:x1875734060666880:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839575.043508:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788839575.043580:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060666880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839575.043589:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060666752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839575.052695:0:10364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10364:1875734060666112:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839575.052740:0:10364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839575.057525:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839575.057644:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118656 00000100:00100000:2.0:1788839575.057654:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118656 00010000:00010000:2.0:1788839575.057693:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 10 pid: 6479 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839575.057733:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1788839575.057742:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050118656:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839575.057757:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839575.057763:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 10 pid: 6479 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.057909:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 10 pid: 6479 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.057929:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842c00/0xad5b343a26572aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f7 expref: 10 pid: 6479 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058058:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058069:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058087:0:8419:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058095:0:8419:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058123:0:8419:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058130:0:8419:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058137:0:8419:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839575.058142:0:8419:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.058151:0:8419:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.058580:0:10364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839575.058591:0:10364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.059757:0:8419:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.059792:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bc3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839575.059813:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839575.059880:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+9:2390:x1875734050118656:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2134us (2360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839575.059891:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:0.0:1788839575.364458:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839575.936298:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839575.936325:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060667264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839575.938401:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839575.938579:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667264 00000100:00100000:3.0:1788839575.938588:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667264 00000100:00100000:3.0:1788839575.938635:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788839575.938644:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060667264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839575.938681:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839575.938723:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060667264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839575.938730:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788839575.938790:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060667264:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839576.170194:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839576.170301:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118784 00000100:00100000:1.0:1788839576.170311:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118784 00000100:00100000:1.0:1788839576.170369:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:1.0:1788839576.170379:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+9:6165:x1875734050118784:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839576.170395:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839576.170417:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7473d expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.170443:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.170470:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.170480:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553e00, rc 0) 00000100:00100000:1.0:1788839576.170552:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050118784:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 174us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.170559:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:3.0:1788839576.175504:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839576.175747:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050118912 00000100:00100000:0.0:1788839576.175758:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050118912 00000100:00100000:0.0:1788839576.175858:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:0.0:1788839576.175869:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050118912:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.176028:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050118912:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 160us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839576.176036:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:1.0:1788839576.186844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839576.187195:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119040 00000100:00100000:3.0:1788839576.187205:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119040 00000100:00100000:3.0:1788839576.187267:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:3.0:1788839576.187279:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050119040:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839576.187432:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:6165:x1875734050119040:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 154us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839576.187440:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:2.0:1788839576.194726:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839576.194852:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119168 00000100:00100000:1.0:1788839576.194862:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119168 00000100:00100000:1.0:1788839576.194921:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:1.0:1788839576.194937:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:6720:x1875734050119168:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839576.195097:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:6720:x1875734050119168:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 167us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.195105:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:3.0:1788839576.202032:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839576.202173:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119296 00000100:00100000:1.0:1788839576.202184:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119296 00000100:00100000:1.0:1788839576.202247:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 257 00000100:00100000:1.0:1788839576.202258:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6720:x1875734050119296:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839576.202847:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:6720:x1875734050119296:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 588us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.202856:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 257 00010000:00010000:2.0:1788839576.385688:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788839576.832578:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839576.832586:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab646536000 from 4 10000000:01000000:2.0:1788839576.832591:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839576.832643:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839576.832675:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839576.832687:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839576.832713:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060667392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839576.832821:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839576.832870:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839576.833153:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667392 00000100:00100000:3.0:1788839576.833161:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667392 00000100:00100000:3.0:1788839576.833215:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788839576.833225:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060667392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839576.833238:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839576.833251:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572bd1 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839576.833274:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839576.833353:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839576.833364:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6c00, rc 0) 00000100:00100000:3.0:1788839576.833413:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060667392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839576.833420:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788839576.834474:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060667392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839576.834494:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839576.835073:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839576.835160:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060667520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839576.835214:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839576.836429:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.836870:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667520 00000100:00100000:1.0:1788839576.836879:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667520 00000100:00100000:1.0:1788839576.836943:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788839576.836968:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060667520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.837257:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060667520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (2042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.837266:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788839576.838665:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060667520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.838727:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060667648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.838823:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839576.838864:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839576.839429:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667648 00000100:00100000:2.0:1788839576.839438:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667648 00000100:00100000:2.0:1788839576.839488:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788839576.839496:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060667648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839576.841757:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060667648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2254us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839576.841792:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788839576.841891:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060667648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839576.844222:0:10432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10432:1875734060667776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839576.846116:0:10432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839576.846581:0:10432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839576.848345:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667776 00000100:00100000:3.0:1788839576.848359:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667776 00000100:00100000:3.0:1788839576.848429:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788839576.848439:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:10432:x1875734060667776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839576.848618:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:10432:x1875734060667776:12345-0@lo:502:llog_process_th.0 Request processed in 180us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839576.848631:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788839576.848824:0:10432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10432:1875734060667776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839576.848862:0:10432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839576.848873:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839576.848876:0:10432:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788839576.848884:0:10432:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab646536000 00000020:00000080:2.0:1788839576.848886:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788839576.849114:0:10432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10432:1875734060667904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839576.849163:0:10432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839576.849248:0:10432:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839576.852726:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060667904 00000100:00100000:0.0:1788839576.852750:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060667904 00000100:00100000:0.0:1788839576.852830:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788839576.852840:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:10432:x1875734060667904:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839576.853032:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:10432:x1875734060667904:12345-0@lo:502:llog_process_th.0 Request processed in 193us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839576.853040:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788839576.853794:0:10432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10432:1875734060667904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839576.853834:0:10432:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839576.853845:0:10432:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839576.853847:0:10432:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788839576.853851:0:10432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788839576.854141:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788839576.854165:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839576.854175:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854186:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839576.854196:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839576.854199:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab777b41000 from 4 10000000:01000000:1.0:1788839576.854201:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839576.854236:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854244:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854253:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839576.854275:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.854343:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839576.854382:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.854399:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668032 00000100:00100000:1.0:1788839576.854404:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668032 00000100:00100000:1.0:1788839576.854440:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788839576.854447:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060668032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839576.854458:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839576.854470:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572bdf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854494:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572bdf expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854503:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bdf expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854530:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:1.0:1788839576.854567:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060668032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.854573:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788839576.854610:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839576.854622:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.854630:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839576.854678:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.854710:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839576.854724:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.854737:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668160 00000100:00100000:1.0:1788839576.854740:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668160 00000100:00100000:1.0:1788839576.854761:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788839576.854767:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060668160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.854881:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060668160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.854887:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788839576.854927:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.854952:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.855116:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839576.855136:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742b57780 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.855147:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668288 00000100:00100000:1.0:1788839576.855151:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668288 00000100:00100000:1.0:1788839576.855172:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788839576.855177:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060668288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.855251:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060668288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.855257:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788839576.855295:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.856748:0:10435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10435:1875734060668416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839576.856975:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.857081:0:10435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab747bdbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.857125:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668416 00000100:00100000:1.0:1788839576.857131:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668416 00000100:00100000:1.0:1788839576.857201:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788839576.857210:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:10435:x1875734060668416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839576.857453:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:10435:x1875734060668416:12345-0@lo:502:llog_process_th.0 Request processed in 244us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.857461:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839576.857540:0:10435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10435:1875734060668416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839576.857570:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839576.857580:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839576.857583:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839576.857590:0:10435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab777b41000 00000020:00000080:0.0:1788839576.857593:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788839576.857809:0:10435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10435:1875734060668544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839576.857845:0:10435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.857862:0:10435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.857927:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668544 00000100:00100000:1.0:1788839576.857931:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668544 00000100:00100000:1.0:1788839576.857963:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788839576.857971:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:10435:x1875734060668544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839576.858056:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:10435:x1875734060668544:12345-0@lo:502:llog_process_th.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.858062:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788839576.858253:0:10435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10435:1875734060668544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839576.858274:0:10435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839576.858278:0:10435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839576.858280:0:10435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788839576.858301:0:10435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788839576.858491:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788839576.858512:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839576.858532:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.858543:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839576.858553:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839576.858556:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab74434b000 from 4 10000000:01000000:1.0:1788839576.858559:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839576.858587:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.858595:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.858603:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839576.858628:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.858669:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839576.858700:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742b57540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839576.859828:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668672 00000100:00100000:0.0:1788839576.859837:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668672 00000100:00100000:0.0:1788839576.859889:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788839576.859969:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060668672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839576.860051:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839576.860069:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572bed expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.860097:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.860107:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.860115:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab740031600, rc 0) 00000100:00100000:0.0:1788839576.860171:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060668672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839576.860177:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788839576.860224:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839576.860239:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.860248:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839576.860384:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.860415:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.860449:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839576.860462:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668800 00000100:00100000:0.0:1788839576.860465:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668800 00000100:00100000:0.0:1788839576.860489:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788839576.860495:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060668800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.860608:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060668800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839576.860614:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788839576.861063:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.861096:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.861136:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.861163:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752180 going to sleep for 11 seconds 00000100:00100000:3.0:1788839576.861291:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060668928 00000100:00100000:3.0:1788839576.861296:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060668928 00000100:00100000:3.0:1788839576.861483:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788839576.861491:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060668928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839576.861657:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060668928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839576.861664:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788839576.861735:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060668928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839576.863280:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10437:1875734060669056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839576.863468:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839576.863590:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839576.863671:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669056 00000100:00100000:0.0:1788839576.863678:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669056 00000100:00100000:0.0:1788839576.863727:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788839576.863737:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:10437:x1875734060669056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839576.863866:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:10437:x1875734060669056:12345-0@lo:502:llog_process_th.0 Request processed in 130us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839576.863874:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788839576.864124:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10437:1875734060669056:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788839576.864155:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839576.864165:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839576.864168:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788839576.864176:0:10437:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab74434b000 00000020:00000080:2.0:1788839576.864190:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788839576.865130:0:10437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10437:1875734060669184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839576.865210:0:10437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839576.865240:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669184 00000100:00100000:3.0:1788839576.865246:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669184 00000100:00100000:1.0:1788839576.865246:0:10437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742b579c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839576.865354:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788839576.865365:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:10437:x1875734060669184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839576.865461:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:10437:x1875734060669184:12345-0@lo:502:llog_process_th.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839576.865469:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788839576.866115:0:10437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10437:1875734060669184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839576.867106:0:10437:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839576.867117:0:10437:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839576.867119:0:10437:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788839576.867123:0:10437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788839576.867607:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788839576.867628:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839576.867640:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.867653:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839576.867673:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839576.867675:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab745341000 from 4 10000000:01000000:0.0:1788839576.867679:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839576.867713:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.867721:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.867730:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839576.867753:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060669312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.867834:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.867874:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.868224:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669312 00000100:00100000:1.0:1788839576.868232:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669312 00000100:00100000:1.0:1788839576.868273:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788839576.868282:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060669312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839576.868295:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839576.868308:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572bfb expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.868331:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572bfb expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.868341:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bfb expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839576.868351:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553800, rc 0) 00000100:00100000:1.0:1788839576.868861:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060669312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 578us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.868878:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788839576.869243:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060669312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839576.869262:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839576.869273:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839576.869341:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060669440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.869376:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.869529:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839576.869618:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669440 00000100:00100000:1.0:1788839576.869623:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669440 00000100:00100000:1.0:1788839576.869700:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788839576.869708:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060669440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.869853:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060669440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839576.869860:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788839576.870129:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060669440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.870162:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060669568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839576.870225:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.870493:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839576.870859:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669568 00000100:00100000:2.0:1788839576.870865:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669568 00000100:00100000:2.0:1788839576.871063:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788839576.871072:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060669568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839576.871284:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060669568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839576.871292:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788839576.873720:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060669568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839576.875224:0:10438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10438:1875734060669696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839576.875321:0:10438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839576.875369:0:10438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742b57540 going to sleep for 11 seconds 00000100:00100000:2.0:1788839576.875531:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669696 00000100:00100000:2.0:1788839576.875973:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669696 00000100:00100000:2.0:1788839576.876046:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788839576.876056:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:10438:x1875734060669696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839576.876226:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:10438:x1875734060669696:12345-0@lo:502:llog_process_th.0 Request processed in 171us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839576.876235:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788839576.876273:0:10438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10438:1875734060669696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839576.876312:0:10438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839576.876322:0:10438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839576.876325:0:10438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839576.876332:0:10438:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab745341000 00000020:00000080:0.0:1788839576.876335:0:10438:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788839576.876423:0:10438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10438:1875734060669824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839576.876462:0:10438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839576.876495:0:10438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839576.876503:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669824 00000100:00100000:3.0:1788839576.876508:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669824 00000100:00100000:3.0:1788839576.876550:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788839576.876557:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:10438:x1875734060669824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839576.876630:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:10438:x1875734060669824:12345-0@lo:502:llog_process_th.0 Request processed in 73us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839576.876647:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788839576.876673:0:10438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:10438:1875734060669824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839576.876692:0:10438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839576.876697:0:10438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839576.876699:0:10438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788839576.876702:0:10438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788839576.877127:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788839576.877148:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839576.877159:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839576.877247:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839577.406915:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839578.431316:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839578.495221:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060669952:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.495300:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839578.495352:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060670464:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.495380:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.496505:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060670208:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.496633:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060670080:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.496663:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.496698:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060670592:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.496719:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.496733:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060671104:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.496752:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.496765:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060671616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839578.496840:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060670976:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.496871:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839578.496890:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060671488:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.496911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839578.496938:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788839578.496945:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060670336:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.496967:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839578.496985:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060670848:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497005:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839578.497037:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060671360:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.497061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839578.497066:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.497135:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670976 00000100:00100000:3.0:1788839578.497143:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670976 00000100:00100000:2.0:1788839578.497144:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670080 00000100:00100000:2.0:1788839578.497150:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670080 00000100:00100000:2.0:1788839578.497194:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670592 00000100:00100000:3.0:1788839578.497198:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671488 00000100:00100000:2.0:1788839578.497198:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670592 00000100:00100000:3.0:1788839578.497205:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671488 00000100:00100000:1.0:1788839578.497226:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670464 00000100:00100000:2.0:1788839578.497227:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671104 00000100:00100000:2.0:1788839578.497232:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671104 00000100:00100000:2.0:1788839578.497249:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670336 00000100:00100000:2.0:1788839578.497251:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670336 00000100:00100000:2.0:1788839578.497266:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788839578.497275:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060670080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.497299:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670848 00000100:00100000:3.0:1788839578.497304:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670848 00000100:00100000:3.0:1788839578.497326:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671360 00000100:00100000:3.0:1788839578.497329:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671360 00000100:00100000:2.0:1788839578.497338:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060670080:12345-0@lo:400:kworker.0 Request processed in 62us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839578.497347:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839578.497350:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839578.497360:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060670976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497373:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839578.497382:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060670592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.497427:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060670976:12345-0@lo:400:kworker.0 Request processed in 68us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839578.497430:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060670592:12345-0@lo:400:kworker.0 Request processed in 48us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.497439:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839578.497442:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839578.497459:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839578.497470:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839578.497471:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060671104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.497481:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060671488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497505:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060671104:12345-0@lo:400:kworker.0 Request processed in 37us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839578.497528:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788839578.497541:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788839578.497548:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060670336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497589:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060670336:12345-0@lo:400:kworker.0 Request processed in 41us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839578.497600:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839578.497601:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060671488:12345-0@lo:400:kworker.0 Request processed in 120us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.497610:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839578.497629:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839578.497641:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839578.497642:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060670848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.497655:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060671360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497676:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060670848:12345-0@lo:400:kworker.0 Request processed in 39us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839578.497684:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839578.497700:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777f22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060671360:12345-0@lo:400:kworker.0 Request processed in 47us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.497707:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839578.497731:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060670080:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497747:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060670592:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497760:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060671104:0@lo:400:kworker.0 00000100:00100000:2.0:1788839578.497818:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060670336:0@lo:400:kworker.0 00010000:00080000:2.0:1788839578.497829:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3b100 x1875734060670848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839578.497838:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060670848:0@lo:400:kworker.0 00010000:00080000:2.0:1788839578.497847:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e39c00 x1875734060671360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839578.497855:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060671360:0@lo:400:kworker.0 00010000:00080000:2.0:1788839578.497863:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3a300 x1875734060670976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839578.497870:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060670976:0@lo:400:kworker.0 00010000:00080000:2.0:1788839578.497877:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e38380 x1875734060671488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839578.497891:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060671488:0@lo:400:kworker.0 00000100:00100000:1.0:1788839578.498091:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670464 00000100:00100000:3.0:1788839578.498318:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060669952 00000100:00100000:3.0:1788839578.498322:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060669952 00000100:00100000:3.0:1788839578.498347:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788839578.498354:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060669952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.498394:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060669952:12345-0@lo:400:kworker.0 Request processed in 40us (3095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.498400:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1788839578.498435:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839578.498577:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839578.498580:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839578.498599:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060671872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839578.498632:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.498667:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.498874:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060670720:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.498901:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839578.498903:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671616 00000100:00100000:0.0:1788839578.498910:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671616 00000100:00100000:3.0:1788839578.498923:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060671232:0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.498964:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839578.498985:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060671744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839578.499032:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671872 00000100:00100000:0.0:1788839578.499037:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671872 00000100:00100000:0.0:1788839578.499052:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839578.499058:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060671616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839578.499083:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839578.499096:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839578.499137:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060671616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (2305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.499153:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060669952:0@lo:400:kworker.0 00000100:00100000:0.0:1788839578.499154:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839578.499176:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671744 00000100:00100000:0.0:1788839578.499181:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671744 00000100:00100000:3.0:1788839578.499192:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670720 00000100:00100000:3.0:1788839578.499198:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670720 00000100:00100000:0.0:1788839578.499202:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788839578.499211:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060671872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839578.499227:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839578.499241:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060671232 00000100:00100000:3.0:1788839578.499246:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060671232 00000100:00100000:0.0:1788839578.499269:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060671872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.499273:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839578.499281:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839578.499286:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060670720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.499326:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060670720:12345-0@lo:400:kworker.0 Request processed in 43us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.499332:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788839578.499344:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839578.499350:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060671232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839578.499376:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060671232:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839578.499381:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788839578.499394:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788839578.499418:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3ad80 x1875734060670720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839578.499430:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060670720:0@lo:400:kworker.0 00000100:00100000:0.0:1788839578.499500:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839578.499518:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060671744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839578.499529:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788839578.499532:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e39f80 x1875734060671232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839578.499543:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060671232:0@lo:400:kworker.0 00000100:00100000:0.0:1788839578.499562:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060671744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (466us total) trans 0 rc 0/0 00010000:00080000:3.0:1788839578.499570:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af4000 x1875734060671744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839578.499571:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839578.499589:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060671744:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788839578.499637:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af5180 x1875734060671616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839578.499649:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060671616:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788839578.499715:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af4a80 x1875734060671872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839578.499729:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060671872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839578.499880:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839578.499890:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060672000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839578.499917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839578.499941:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672000 00000100:00100000:0.0:1788839578.499944:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672000 00000100:00100000:0.0:1788839578.499964:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839578.499969:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060672000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839578.499985:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839578.500012:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060672000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839578.500018:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788839578.500040:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5d880 x1875734060672000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839594 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839578.500052:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060672000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839578.501296:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060670208 00000100:00100000:1.0:1788839578.501306:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060670208 00000100:00100000:1.0:1788839578.501349:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788839578.501370:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060670464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839578.501461:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060670464:12345-0@lo:400:kworker.0 Request processed in 104us (6080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839578.501468:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788839578.501484:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839578.501490:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060670208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839578.501552:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060670208:12345-0@lo:400:kworker.0 Request processed in 61us (2883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839578.501559:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788839578.501732:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060670464:0@lo:400:kworker.0 00000100:00100000:1.0:1788839578.501812:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060670208:0@lo:400:kworker.0 00000100:00100000:3.0:1788839579.006997:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839579.007022:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060672128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839579.007089:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839579.007165:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672128 00000100:00100000:3.0:1788839579.007172:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672128 00000100:00100000:3.0:1788839579.007224:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788839579.007232:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060672128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839579.007266:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839579.007321:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060672128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839579.007328:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788839579.007387:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060672128:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788839579.455610:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839579.821418:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839579.821457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839579.821483:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839579.821512:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839579.821548:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839579.821576:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119680 00000100:00100000:0.0:1788839579.821585:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119680 00000100:00100000:0.0:1788839579.821637:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119552 00000100:00100000:0.0:1788839579.821639:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119552 00000100:00100000:0.0:1788839579.821656:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788839579.821667:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050119680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839579.821739:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050119680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839579.821748:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1788839579.821765:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788839579.821956:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050119552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839579.822001:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050119552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 229us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839579.822014:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788839579.822034:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119936 00000100:00100000:0.0:1788839579.822038:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119936 00000100:00100000:0.0:1788839579.822069:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119808 00000100:00100000:0.0:1788839579.822071:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119808 00000100:00100000:0.0:1788839579.822092:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788839579.822098:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050119936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839579.822137:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050119936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839579.822144:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1788839579.822322:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050119424 00000100:00100000:2.0:1788839579.822326:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050119424 00000100:00100000:2.0:1788839579.822358:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 279 00000100:00100000:2.0:1788839579.822364:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050119424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839579.822389:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:2390:x1875734050119424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839579.822394:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 279 00000100:00100000:0.0:1788839579.823381:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788839579.823395:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050119808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839579.823442:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050119808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 53us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839579.823449:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00080000:0.0:1788839579.823483:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839579.823487:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839579.823491:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839579.823493:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788839580.479001:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839581.055004:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839581.055029:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060672256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839581.055099:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839581.055172:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672256 00000100:00100000:2.0:1788839581.055180:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672256 00000100:00100000:2.0:1788839581.055227:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839581.055236:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060672256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839581.055272:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839581.055319:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060672256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839581.055326:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839581.055376:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060672256:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788839581.349650:0:10664:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788839581.503725:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839582.528406:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839583.551922:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839583.615216:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060672384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839583.615288:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.615347:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839583.615353:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060672512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839583.615377:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839583.616156:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839583.616168:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060672640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839583.616206:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.616296:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839583.616307:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060672768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839583.619380:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060672896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619452:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.619506:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060673408:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619532:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.619551:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060673920:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619572:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.619608:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788839583.619614:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060673024:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.619655:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060673536:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.619691:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060674048:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.619762:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673408 00000100:00100000:1.0:1788839583.619786:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673408 00000100:00100000:1.0:1788839583.619832:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839583.619842:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060673408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.619897:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060673408:12345-0@lo:400:kworker.0 Request processed in 56us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.619904:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839583.619926:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673920 00000100:00100000:1.0:1788839583.619930:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673920 00000100:00100000:1.0:1788839583.619958:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673024 00000100:00100000:1.0:1788839583.619961:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673024 00000100:00100000:1.0:1788839583.619971:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673536 00000100:00100000:1.0:1788839583.619973:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673536 00000100:00100000:1.0:1788839583.619983:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674048 00000100:00100000:1.0:1788839583.619985:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674048 00000100:00100000:1.0:1788839583.619997:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839583.620003:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060673920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620046:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060673920:12345-0@lo:400:kworker.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.620052:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839583.620064:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788839583.620070:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060673024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620097:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060673024:12345-0@lo:400:kworker.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.620102:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788839583.620112:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839583.620119:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060673536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620142:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060673536:12345-0@lo:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.620155:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839583.620166:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839583.620172:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060674048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620199:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060674048:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.620204:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788839583.620231:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839583.620235:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839583.620261:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060673024:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620272:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060673536:0@lo:400:kworker.0 00010000:00080000:1.0:1788839583.620283:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ef480 x1875734060674048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839583.620292:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060674048:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620301:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060673408:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.620309:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060673920:0@lo:400:kworker.0 00000100:00100000:3.0:1788839583.621358:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060673280:0@lo:400:kworker.0 00000100:00100000:2.0:1788839583.621371:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672384 00000100:00100000:2.0:1788839583.621379:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672384 00000100:00100000:3.0:1788839583.621420:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839583.621429:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672512 00000100:00100000:2.0:1788839583.621434:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672512 00000100:00100000:3.0:1788839583.621442:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060673792:0@lo:400:kworker.0 00000100:00100000:2.0:1788839583.621448:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672640 00000100:00100000:2.0:1788839583.621459:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672640 00000100:00100000:3.0:1788839583.621500:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839583.621500:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839583.621513:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060672384:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839583.621534:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673792 00000100:00100000:3.0:1788839583.621538:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673792 00000100:00100000:3.0:1788839583.621573:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788839583.621580:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060673792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839583.621622:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060673792:12345-0@lo:400:kworker.0 Request processed in 42us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839583.621629:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788839583.621670:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5b480 x1875734060673792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839583.621683:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060673792:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.621686:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839583.621704:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788839583.621714:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060673152:0@lo:400:kworker.0 00000100:00080000:1.0:1788839583.621719:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839583.621724:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839583.621735:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673280 00000100:00100000:1.0:1788839583.621739:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673280 00000100:00100000:3.0:1788839583.621744:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839583.621764:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060673664:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.621808:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788839583.621810:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.621820:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060673280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839583.621832:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060674176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.621865:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060673280:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839583.621867:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839583.621886:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788839583.621891:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674176 00000100:00100000:3.0:1788839583.621896:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674176 00000100:00100000:1.0:1788839583.621903:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673664 00000100:00100000:1.0:1788839583.621909:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673664 00000100:00100000:3.0:1788839583.621923:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839583.621933:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060674176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.621949:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788839583.621958:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060673664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839583.621968:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060674176:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839583.621974:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788839583.622001:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060673664:12345-0@lo:400:kworker.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.622008:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788839583.622019:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766eca80 x1875734060674176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839583.622030:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060674176:0@lo:400:kworker.0 00000100:00100000:3.0:1788839583.622041:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060673280:0@lo:400:kworker.0 00010000:00080000:3.0:1788839583.622059:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58a80 x1875734060673664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839583.622067:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060673664:0@lo:400:kworker.0 00002000:00000024:2.0:1788839583.622135:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839583.622213:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788839583.622228:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672896 00000100:00100000:0.0:1788839583.622231:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672896 00000100:00100000:0.0:1788839583.622262:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788839583.622270:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060672896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839583.622350:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060672384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 841us (7061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839583.622357:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839583.622369:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060672768 00000100:00100000:2.0:1788839583.622373:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060672768 00000100:00100000:2.0:1788839583.622387:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839583.622393:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060672512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839583.622407:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788839583.622456:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839583.622494:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060673152 00000100:00100000:1.0:1788839583.622498:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060673152 00000100:00100000:1.0:1788839583.622533:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839583.622540:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060673152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839583.622578:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060673152:12345-0@lo:400:kworker.0 Request processed in 39us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839583.622584:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788839583.622642:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060672896:12345-0@lo:400:kworker.0 Request processed in 373us (3190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839583.622655:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788839583.622685:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788839583.622878:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060673152:0@lo:400:kworker.0 00000100:00100000:2.0:1788839583.622959:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060672512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 565us (7579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839583.622967:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839583.622981:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839583.622989:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060672640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839583.622999:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839583.623181:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060672640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (6974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839583.623188:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839583.623199:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839583.623206:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060672768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839583.623216:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839583.623251:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060672768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839583.623267:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839583.623335:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060672896:0@lo:400:kworker.0 00010000:00080000:1.0:1788839583.623349:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a30a80 x1875734060672512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839583.623364:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060672512:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788839583.623376:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b1880 x1875734060672384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839583.623386:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060672384:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788839583.624958:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af5180 x1875734060672640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839583.624980:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060672640:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788839583.625319:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eef100 x1875734060672768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839599 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839583.625740:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060672768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839584.134509:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060674304:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839584.134601:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839584.137214:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674304 00000100:00100000:2.0:1788839584.137228:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674304 00000100:00100000:2.0:1788839584.137286:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788839584.137295:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060674304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839584.137332:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788839584.138426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060674304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1127us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839584.138436:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788839584.138609:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060674304:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788839584.580069:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839584.952194:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839584.952249:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839584.952275:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839584.952299:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839584.952394:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839584.952430:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120320 00000100:00100000:3.0:1788839584.952439:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120320 00000100:00100000:3.0:1788839584.952518:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120192 00000100:00100000:3.0:1788839584.952522:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120192 00000100:00100000:3.0:1788839584.952548:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:3.0:1788839584.952558:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050120320:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839584.952645:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050120320:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 88us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839584.952653:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:3.0:1788839584.952686:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:3.0:1788839584.952693:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050120192:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839584.952721:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050120192:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839584.952727:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:3.0:1788839584.952747:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120448 00000100:00100000:3.0:1788839584.952751:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120448 00000100:00100000:3.0:1788839584.952798:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120576 00000100:00100000:3.0:1788839584.952802:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120576 00000100:00100000:3.0:1788839584.952822:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788839584.952828:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2388:x1875734050120448:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788839584.952858:0:8404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572b14 00000100:00080000:3.0:1788839584.952876:0:8404:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839584.952922:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788839584.953054:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+2:2388:x1875734050120448:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 224us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839584.953060:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788839584.953072:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788839584.953079:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2388:x1875734050120576:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788839584.953091:0:8404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572b1b 00000100:00080000:3.0:1788839584.953097:0:8404:0:(import.c:65:import_set_state_nolock()) ffff8ab647a21000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839584.953120:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788839584.953190:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+2:2388:x1875734050120576:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 111us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839584.953196:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:3.0:1788839584.953213:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839584.953222:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839584.953225:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839584.953227:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788839584.953297:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839584.953303:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839584.953821:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120064 00000100:00100000:0.0:1788839584.953829:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120064 00000100:00100000:0.0:1788839584.953924:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 281 00000100:00100000:0.0:1788839584.953934:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050120064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839584.953969:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050120064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (1789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839584.953976:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 281 00010000:00010000:3.0:1788839585.599531:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839586.175631:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060674432:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839586.175707:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839586.176130:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674432 00000100:00100000:3.0:1788839586.176138:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674432 00000100:00100000:3.0:1788839586.176196:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839586.176205:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060674432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839586.176239:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839586.176285:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060674432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839586.176292:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788839586.176377:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060674432:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788839586.295533:0:10909:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing yml_node 00010000:00010000:2.0:1788839586.624017:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839587.648517:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839588.671206:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839588.735200:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060674560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839588.735274:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.735582:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060674688:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.735617:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.735660:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674688 00000100:00100000:3.0:1788839588.735666:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674688 00000100:00100000:3.0:1788839588.735715:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788839588.735724:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060674688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.735788:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060674688:12345-0@lo:400:kworker.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.735796:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788839588.735845:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060674688:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.735882:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060674816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.735923:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.735968:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674816 00000100:00100000:3.0:1788839588.735971:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674816 00000100:00100000:3.0:1788839588.736084:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788839588.736092:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060674816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736130:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060674816:12345-0@lo:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.736136:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788839588.736169:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060674816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736202:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839588.736208:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060674944:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736233:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.736260:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674944 00000100:00100000:3.0:1788839588.736263:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674944 00000100:00100000:3.0:1788839588.736288:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839588.736294:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060674944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736330:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060674944:12345-0@lo:400:kworker.0 Request processed in 36us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.736336:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839588.736377:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060674944:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736410:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060675072:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736434:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.736471:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675072 00000100:00100000:3.0:1788839588.736475:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675072 00000100:00100000:3.0:1788839588.736498:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788839588.736504:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060675072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736538:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060675072:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.736555:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788839588.736585:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060675072:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736616:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060675200:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736641:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.736663:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675200 00000100:00100000:3.0:1788839588.736666:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675200 00000100:00100000:3.0:1788839588.736688:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839588.736694:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060675200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736725:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060675200:12345-0@lo:400:kworker.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.736731:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839588.736758:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060675200:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736814:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060675328:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736838:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.736862:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675328 00000100:00100000:3.0:1788839588.736866:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675328 00000100:00100000:3.0:1788839588.736894:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788839588.736899:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060675328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.736933:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060675328:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.736939:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:3.0:1788839588.736954:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839588.736972:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060675328:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737000:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839588.737015:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060675456:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737054:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.737077:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675456 00000100:00100000:3.0:1788839588.737080:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675456 00000100:00100000:3.0:1788839588.737104:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788839588.737111:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060675456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737144:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060675456:12345-0@lo:400:kworker.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.737151:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788839588.737165:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788839588.737183:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4ce00 x1875734060675456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839588.737194:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060675456:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737225:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060675584:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737249:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.737275:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675584 00000100:00100000:3.0:1788839588.737279:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675584 00000100:00100000:3.0:1788839588.737307:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788839588.737313:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060675584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737348:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060675584:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.737354:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788839588.737371:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788839588.737387:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9180 x1875734060675584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839588.737396:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060675584:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737435:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060675712:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737474:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.737500:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675712 00000100:00100000:3.0:1788839588.737503:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675712 00000100:00100000:3.0:1788839588.737527:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788839588.737533:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060675712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737566:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060675712:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.737572:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788839588.737586:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839588.737602:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060675712:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737632:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060675840:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737654:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.737676:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675840 00000100:00100000:3.0:1788839588.737679:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675840 00000100:00100000:3.0:1788839588.737703:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788839588.737709:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060675840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737742:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060675840:12345-0@lo:400:kworker.0 Request processed in 33us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.737747:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788839588.737760:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788839588.737798:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9180 x1875734060675840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839588.737807:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060675840:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737838:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839588.737852:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737875:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839588.737899:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060675968 00000100:00100000:3.0:1788839588.737902:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060675968 00000100:00100000:3.0:1788839588.737930:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839588.737942:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060675968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.737976:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060675968:12345-0@lo:400:kworker.0 Request processed in 40us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839588.737982:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1788839588.738001:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788839588.738018:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9180 x1875734060675968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839588.738026:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060675968:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.738055:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060676096:0@lo:400:kworker.0 00000100:00100000:3.0:1788839588.738077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839588.738632:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060674560 00000100:00100000:2.0:1788839588.738638:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060674560 00000100:00100000:2.0:1788839588.738687:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788839588.738694:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060674560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839588.738719:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839588.738791:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060674560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839588.738797:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1788839588.738813:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839588.738820:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839588.738827:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060676224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839588.738867:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839588.738896:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676224 00000100:00100000:2.0:1788839588.738900:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676224 00000100:00100000:2.0:1788839588.738933:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788839588.738939:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060676224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839588.738966:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839588.739000:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060676224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839588.739007:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788839588.739035:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a33800 x1875734060676224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839588.739050:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060676224:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788839588.739076:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443d9f80 x1875734060674560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839588.739087:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060674560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839588.740579:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676096 00000100:00100000:0.0:1788839588.740587:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676096 00000100:00100000:0.0:1788839588.740644:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788839588.740653:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060676096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839588.740727:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060676096:12345-0@lo:400:kworker.0 Request processed in 75us (2648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839588.740733:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788839588.740752:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839588.740803:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060676352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839588.740839:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839588.740875:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676352 00000100:00100000:0.0:1788839588.740879:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676352 00000100:00100000:0.0:1788839588.740903:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839588.740922:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060676352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839588.740937:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839588.740970:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060676352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839588.740977:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788839588.741013:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b0700 x1875734060676352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839588.741028:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060676352:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788839588.742161:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9180 x1875734060676096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839588.742176:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060676096:0@lo:400:kworker.0 00000100:00100000:2.0:1788839588.742194:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839588.742202:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060676480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839588.742241:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839588.742501:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676480 00000100:00100000:1.0:1788839588.742507:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676480 00000100:00100000:1.0:1788839588.742552:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788839588.742561:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060676480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839588.742579:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839588.742619:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060676480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839588.742626:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788839588.743077:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766ef480 x1875734060676480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839604 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839588.743094:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060676480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839589.250680:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060676608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839589.250762:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839589.250952:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676608 00000100:00100000:3.0:1788839589.251035:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676608 00000100:00100000:3.0:1788839589.251097:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839589.251107:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060676608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839589.251142:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839589.251196:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060676608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839589.251203:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788839589.251291:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060676608:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788839589.696328:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839590.056064:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839590.056117:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839590.056161:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839590.056229:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120832 00000100:00100000:2.0:1788839590.056254:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120832 00000100:00100000:3.0:1788839590.056317:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120960 00000100:00100000:3.0:1788839590.056323:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120960 00000100:00100000:1.0:1788839590.056401:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050120704 00000100:00100000:1.0:1788839590.056406:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050120704 00000100:00100000:1.0:1788839590.056825:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 283 00000100:00100000:1.0:1788839590.056837:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050120704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839590.056921:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050120704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 87us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839590.056929:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 283 00000100:00100000:2.0:1788839590.061087:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1788839590.061111:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050120832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839590.061204:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050120832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 103us (5150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839590.061213:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00080000:0.0:1788839590.066664:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839590.066675:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839590.069213:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:1.0:1788839590.069242:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050120960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839590.069326:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050120960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 99us (13163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839590.069352:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00010000:00010000:2.0:1788839590.721478:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788839590.787044:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:1.0:1788839590.787054:0:8397:0:(genops.c:885:class_export_put()) final put ffff8ab646b3a000/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:2.0:1788839590.787389:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3a000/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-OST0000 00000020:00000080:2.0:1788839590.787460:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b3d800 for lustre-OST0000 00000001:00100000:1.0:1788839590.787829:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:1.0:1788839590.787833:0:9483:0:(genops.c:885:class_export_put()) final put ffff8ab647a22000/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:0.0:1788839590.787893:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a22000/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-OST0001 00000020:00000080:0.0:1788839590.787928:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a21000 for lustre-OST0001 00000001:02000400:3.0:1788839591.281431:0:11092:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.115 00000100:00100000:0.0:1788839591.295766:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060676736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839591.295872:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839591.296142:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676736 00000100:00100000:3.0:1788839591.296151:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676736 00000100:00100000:3.0:1788839591.296203:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788839591.296211:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060676736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839591.296351:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839591.296454:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060676736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 243us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839591.296461:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788839591.299054:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060676736:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839591.743977:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839592.769969:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839593.636232:0:11190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.115 00010000:00010000:3.0:1788839593.793788:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839593.855864:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060676992:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.855946:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856005:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060677504:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856029:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856056:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060678016:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856079:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856106:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060678528:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839593.856131:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856155:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788839593.856161:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060677120:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856184:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856207:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060677632:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856229:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856248:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060678144:0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.856258:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060676864:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856270:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856300:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676992 00000100:00100000:2.0:1788839593.856306:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856308:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676992 00000100:00100000:2.0:1788839593.856342:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060677376:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856350:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677504 00000100:00100000:1.0:1788839593.856354:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677504 00000100:00100000:2.0:1788839593.856370:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839593.856388:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060677888:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856390:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678016 00000100:00100000:1.0:1788839593.856395:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678016 00000100:00100000:1.0:1788839593.856429:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677632 00000100:00100000:1.0:1788839593.856433:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677632 00000100:00100000:2.0:1788839593.856435:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856452:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678144 00000100:00100000:1.0:1788839593.856456:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678144 00000100:00100000:2.0:1788839593.856462:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060678400:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856475:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788839593.856486:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060676992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.856491:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839593.856515:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788839593.856522:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060677248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.856555:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856555:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060676992:12345-0@lo:400:kworker.0 Request processed in 69us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.856566:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788839593.856583:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677248 00000100:00100000:1.0:1788839593.856586:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677248 00000100:00100000:1.0:1788839593.856604:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788839593.856609:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060677504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856639:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060677504:12345-0@lo:400:kworker.0 Request processed in 30us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.856646:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788839593.856661:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839593.856668:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060678016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856697:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060678016:12345-0@lo:400:kworker.0 Request processed in 30us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.856704:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839593.856716:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788839593.856722:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060677632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.856743:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060677760:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856753:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060677632:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.856798:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788839593.856801:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856817:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788839593.856825:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060678144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.856837:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060678272:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856860:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060678144:12345-0@lo:400:kworker.0 Request processed in 35us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.856868:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788839593.856874:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839593.856884:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788839593.856893:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060677248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.856935:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060677248:12345-0@lo:400:kworker.0 Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.856943:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788839593.856965:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839593.856970:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839593.856982:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677120 00000100:00100000:0.0:1788839593.856988:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677120 00000100:00100000:0.0:1788839593.857027:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677376 00000100:00100000:0.0:1788839593.857031:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677376 00000100:00100000:0.0:1788839593.857054:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788839593.857063:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060677120:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788839593.857088:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58380 x1875734060677632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839593.857103:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060677632:0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.857109:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060677120:12345-0@lo:400:kworker.0 Request processed in 46us (921us total) trans 0 rc 0/0 00010000:00080000:1.0:1788839593.857120:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eefb80 x1875734060678144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.857120:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788839593.857131:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060678144:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.857144:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060676992:0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.857146:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788839593.857164:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060677504:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.857176:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060678016:0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.857189:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677888 00000100:00100000:2.0:1788839593.857195:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677888 00000100:00100000:1.0:1788839593.857201:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839593.857218:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060678656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839593.857229:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678400 00000100:00100000:2.0:1788839593.857234:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678400 00000100:00100000:1.0:1788839593.857250:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839593.857253:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060677376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.857254:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060677760 00000100:00100000:2.0:1788839593.857260:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060677760 00000100:00100000:2.0:1788839593.857283:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678272 00000100:00100000:1.0:1788839593.857284:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060677120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.857289:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678272 00000100:00100000:1.0:1788839593.857312:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678528 00000100:00100000:2.0:1788839593.857314:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788839593.857318:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678528 00000100:00100000:2.0:1788839593.857325:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060677888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.857347:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678656 00000100:00100000:1.0:1788839593.857351:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678656 00000100:00100000:0.0:1788839593.857436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060677376:12345-0@lo:400:kworker.0 Request processed in 189us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839593.857444:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788839593.857449:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060677888:12345-0@lo:400:kworker.0 Request processed in 124us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839593.857458:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839593.857474:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839593.857478:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788839593.857486:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060678528:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839593.857490:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060678400:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788839593.857511:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839593.857549:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060678528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839593.857556:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788839593.857593:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b3480 x1875734060678528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.857607:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060678528:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839593.857683:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060678784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839593.857712:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839593.857740:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839593.857751:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060678912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839593.857806:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839593.857830:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060676864 00000100:00100000:3.0:1788839593.857834:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060676864 00000100:00100000:3.0:1788839593.857861:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788839593.857868:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060676864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.857894:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678784 00000100:00100000:0.0:1788839593.857899:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678784 00000100:00100000:0.0:1788839593.857918:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060678912 00000100:00100000:3.0:1788839593.857919:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060676864:12345-0@lo:400:kworker.0 Request processed in 47us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839593.857922:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060678912 00000100:00100000:3.0:1788839593.857930:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788839593.857942:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788839593.857950:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060678784:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839593.857972:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00002000:00000024:0.0:1788839593.857973:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839593.857984:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060677760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.858017:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060678784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839593.858027:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788839593.858030:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060677760:12345-0@lo:400:kworker.0 Request processed in 45us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839593.858039:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788839593.858045:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788839593.858058:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875734060678912:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839593.858069:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00002000:00000024:0.0:1788839593.858074:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839593.858080:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060678272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.858109:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875734060678912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839593.858118:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788839593.858124:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1875734060678272:12345-0@lo:400:kworker.0 Request processed in 47us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839593.858131:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788839593.858150:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e39c00 x1875734060678912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.859036:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060678912:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788839593.859057:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3a300 x1875734060678784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.859069:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060678784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839593.860931:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060677248:0@lo:400:kworker.0 00010000:00080000:0.0:1788839593.860950:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eef100 x1875734060677760/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.860960:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060677760:0@lo:400:kworker.0 00010000:00080000:0.0:1788839593.860973:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c74700 x1875734060678272/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.860980:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060678272:0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.861001:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060676864:0@lo:400:kworker.0 00000100:00100000:0.0:1788839593.861014:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060677376:0@lo:400:kworker.0 00010000:00080000:0.0:1788839593.861025:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed180 x1875734060677888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.861032:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060677888:0@lo:400:kworker.0 00000100:00100000:2.0:1788839593.861514:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060678400:12345-0@lo:400:kworker.0 Request processed in 4025us (5022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839593.861525:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788839593.861567:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839593.861572:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839593.861731:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839593.861746:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060678656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839593.861877:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788839593.861895:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c74a80 x1875734060678400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.861906:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060678400:0@lo:400:kworker.0 00000100:00100000:1.0:1788839593.862483:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060678656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 741us (5232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839593.862491:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788839593.865640:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e38380 x1875734060678656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839609 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839593.865668:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060678656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839594.371748:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060679040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839594.371864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839594.372155:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679040 00000100:00100000:3.0:1788839594.372164:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679040 00000100:00100000:3.0:1788839594.372231:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839594.372241:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060679040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839594.372276:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839594.372326:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060679040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839594.372333:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839594.372380:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060679040:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788839594.831534:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839595.176348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839595.177083:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121088 00000100:00100000:0.0:1788839595.177093:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121088 00000100:00100000:0.0:1788839595.177153:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 285 00000100:00100000:0.0:1788839595.177162:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:2389:x1875734050121088:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839595.177238:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:2389:x1875734050121088:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 77us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839595.177246:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 285 00000100:00100000:1.0:1788839595.180387:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839595.180488:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121216 00000100:00100000:2.0:1788839595.180498:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121216 00000100:00100000:2.0:1788839595.180578:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:2.0:1788839595.180588:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050121216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839595.180667:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050121216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839595.180675:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00080000:1.0:1788839595.180745:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839595.194338:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839595.194575:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121344 00000100:00100000:0.0:1788839595.194587:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121344 00000100:00100000:0.0:1788839595.194716:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:0.0:1788839595.194748:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050121344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839595.194864:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050121344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 121us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839595.194873:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00080000:1.0:1788839595.196356:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788839595.840917:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839596.285348:0:11287:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.115 00000100:00100000:1.0:1788839596.417681:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839596.417707:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060679168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839596.417807:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839596.417920:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679168 00000100:00100000:0.0:1788839596.417928:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679168 00000100:00100000:0.0:1788839596.417985:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788839596.417996:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060679168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839596.418032:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839596.418080:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060679168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839596.418087:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839596.418410:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060679168:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839596.865006:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839597.776151:0:11335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 23:53:15 EDT 2026 00010000:00010000:1.0:1788839597.886946:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839598.911114:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839598.975010:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060679296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839598.975078:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839598.975196:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060679424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839598.975225:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839598.975274:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679296 00000100:00100000:3.0:1788839598.975283:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679296 00000100:00100000:3.0:1788839598.975351:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679424 00000100:00100000:3.0:1788839598.975366:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679424 00000100:00100000:2.0:1788839598.975384:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839598.975399:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060679296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839598.975401:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788839598.975414:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060679424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839598.975431:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788839598.975435:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788839598.975532:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839598.975537:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839598.980221:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060679424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4798us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839598.980237:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788839598.980315:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b0000 x1875734060679296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839598.980353:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060679296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4955us (5271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839598.980363:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839598.980382:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060679296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839598.980416:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060679552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839598.980469:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.980518:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839598.980525:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060679680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839598.980552:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.980720:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060680192:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.980749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839598.980788:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060679936:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.981010:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060680704:0@lo:400:kworker.0 00000100:00100000:0.0:1788839598.981028:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680192 00000100:00100000:0.0:1788839598.981037:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680192 00000100:00100000:2.0:1788839598.981041:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.981072:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788839598.981080:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060680064:0@lo:400:kworker.0 00000100:00100000:0.0:1788839598.981083:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680704 00000100:00100000:0.0:1788839598.981087:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680704 00000100:00100000:2.0:1788839598.981111:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839598.981123:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788839598.981133:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060680192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.981136:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060680576:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.981163:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.981189:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680064 00000100:00100000:2.0:1788839598.981193:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680064 00000100:00100000:0.0:1788839598.981205:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060680192:12345-0@lo:400:kworker.0 Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839598.981214:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788839598.981229:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788839598.981231:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680576 00000100:00100000:0.0:1788839598.981236:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680576 00000100:00100000:2.0:1788839598.981241:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060680064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839598.981259:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788839598.981268:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060680704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.981301:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060680064:12345-0@lo:400:kworker.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839598.981308:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788839598.981314:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060680704:12345-0@lo:400:kworker.0 Request processed in 46us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839598.981321:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788839598.981339:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839598.981342:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839598.981350:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060680576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.981363:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060680448:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.981399:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788839598.981420:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819faa00 x1875734060679424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839598.981436:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060679424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839598.981456:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788839598.981462:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060679808:0@lo:400:kworker.0 00000100:00100000:3.0:1788839598.981526:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679936 00000100:00100000:3.0:1788839598.981530:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679936 00000100:00100000:3.0:1788839598.981548:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680448 00000100:00100000:3.0:1788839598.981551:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680448 00000100:00100000:3.0:1788839598.981564:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788839598.981570:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060679936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839598.981643:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679552 00000100:00100000:1.0:1788839598.981647:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679552 00000100:00100000:1.0:1788839598.981676:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679680 00000100:00100000:1.0:1788839598.981678:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679680 00000100:00100000:1.0:1788839598.981694:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839598.981700:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060679552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839598.981735:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839598.987083:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.987163:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060680320:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.987205:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.987225:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060680832:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.987246:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839598.987280:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680320 00000100:00100000:2.0:1788839598.987287:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680320 00000100:00100000:2.0:1788839598.987334:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788839598.987343:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060680320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.987413:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060680320:12345-0@lo:400:kworker.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839598.987420:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788839598.987462:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839598.987471:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060679680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839598.987507:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839598.987547:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060679680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (6994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839598.987553:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788839598.987591:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c74000 x1875734060679680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839598.987612:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060679680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839598.987648:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060680064:0@lo:400:kworker.0 00010000:00080000:2.0:1788839598.987660:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647b6d500 x1875734060680576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839598.987668:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060680576:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.987680:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060680192:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.987690:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060680704:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.987880:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060680320:0@lo:400:kworker.0 00000100:00100000:3.0:1788839598.988042:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060679936:12345-0@lo:400:kworker.0 Request processed in 6469us (6702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839598.988052:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788839598.988070:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680832 00000100:00100000:3.0:1788839598.988075:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680832 00000100:00100000:3.0:1788839598.988100:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788839598.988106:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060680448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839598.988143:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060680448:12345-0@lo:400:kworker.0 Request processed in 38us (6743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839598.988148:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788839598.988160:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788839598.988165:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060680832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839598.988188:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060680832:12345-0@lo:400:kworker.0 Request processed in 23us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839598.988193:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:2.0:1788839598.988598:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647b6e300 x1875734060680832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839614 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839598.988609:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060680832:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.988620:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060679936:0@lo:400:kworker.0 00000100:00100000:2.0:1788839598.988630:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060680448:0@lo:400:kworker.0 00000100:00100000:1.0:1788839598.989084:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060679552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7381us (8612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839598.989092:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788839598.989189:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3b100 x1875734060679552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839614 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839598.989225:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060679552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839598.992978:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060680576:12345-0@lo:400:kworker.0 Request processed in 11621us (11804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839598.992994:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788839598.993043:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060679808 00000100:00100000:0.0:1788839598.993051:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060679808 00000100:00100000:0.0:1788839598.993109:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788839598.993117:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060679808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839598.993202:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060679808:12345-0@lo:400:kworker.0 Request processed in 86us (6126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839598.993208:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1788839598.993241:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839598.993246:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839598.993249:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839598.993251:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839598.994338:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060679808:0@lo:400:kworker.0 00000100:00100000:2.0:1788839599.488708:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060680960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839599.488848:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839599.488967:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060680960 00000100:00100000:3.0:1788839599.488976:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060680960 00000100:00100000:3.0:1788839599.489029:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788839599.489037:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060680960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839599.489078:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839599.489364:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060680960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 316us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839599.489383:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788839599.489600:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060680960:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788839599.945555:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839600.299372:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839600.299416:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839600.299451:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839600.299513:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121600 00000100:00100000:3.0:1788839600.299523:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121600 00000100:00100000:1.0:1788839600.299524:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121472 00000100:00100000:1.0:1788839600.299531:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121472 00000100:00100000:3.0:1788839600.299584:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121728 00000100:00100000:3.0:1788839600.299588:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121728 00000100:00100000:3.0:1788839600.299612:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1788839600.299621:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050121600:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839600.299697:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050121600:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 77us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839600.299707:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:1.0:1788839600.299707:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 287 00000100:00100000:1.0:1788839600.299722:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:2392:x1875734050121472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839600.299729:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1788839600.299739:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050121728:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839600.299756:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:2392:x1875734050121472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839600.299794:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050121728:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839600.299799:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 287 00000100:00100000:3.0:1788839600.299806:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00080000:2.0:1788839600.299990:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839600.299994:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839600.965408:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839601.535097:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060681088:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839601.535185:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839601.535342:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681088 00000100:00100000:0.0:1788839601.535373:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681088 00000100:00100000:0.0:1788839601.535429:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788839601.535438:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060681088:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839601.535476:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839601.535545:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060681088:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839601.535553:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788839601.535934:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060681088:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839601.983649:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839603.011031:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839604.031003:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839604.095053:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060681216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839604.095125:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839604.095281:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681216 00000100:00100000:2.0:1788839604.095289:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681216 00000100:00100000:2.0:1788839604.095358:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788839604.095370:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060681216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839604.095397:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788839604.095481:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839604.095529:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060681344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839604.095566:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.095599:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839604.095607:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060681472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839604.095633:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681344 00000100:00100000:0.0:1788839604.095635:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839604.095640:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681344 00000100:00100000:1.0:1788839604.095676:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681472 00000100:00100000:1.0:1788839604.095680:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681472 00000100:00100000:1.0:1788839604.095697:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839604.095704:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060681344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788839604.095716:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839604.095764:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060681216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839604.095766:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060681344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839604.095794:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788839604.095843:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b0000 x1875734060681216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839604.095862:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060681216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839604.095894:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839604.095900:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060681600:0@lo:400:kworker.0 00000100:00100000:3.0:1788839604.095930:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.097443:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060682112:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.097485:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.097512:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060682624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.097528:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.097545:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788839604.097550:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060681728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839604.097567:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.097574:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060682240:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.097590:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.097602:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060682752:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.097615:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.097638:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682112 00000100:00100000:0.0:1788839604.097642:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682112 00000100:00100000:0.0:1788839604.097688:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682624 00000100:00100000:0.0:1788839604.097690:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682624 00000100:00100000:0.0:1788839604.097703:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682752 00000100:00100000:0.0:1788839604.097704:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682752 00000100:00100000:0.0:1788839604.097716:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788839604.097722:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060682112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.098540:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060682112:12345-0@lo:400:kworker.0 Request processed in 814us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.098549:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788839604.098569:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788839604.098576:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060682624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.098596:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060682624:12345-0@lo:400:kworker.0 Request processed in 22us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.098601:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788839604.098609:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788839604.098614:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060682752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.098631:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060682752:12345-0@lo:400:kworker.0 Request processed in 18us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.098636:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788839604.098653:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682240 00000100:00100000:0.0:1788839604.098657:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682240 00000100:00100000:0.0:1788839604.098687:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788839604.098692:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060682240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.098717:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060682240:12345-0@lo:400:kworker.0 Request processed in 26us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.098722:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788839604.098894:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839604.098907:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839604.098910:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839604.098912:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839604.098940:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060682240:0@lo:400:kworker.0 00010000:00080000:0.0:1788839604.098951:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647978e00 x1875734060682752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839604.098960:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060682752:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.098967:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060682112:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.098974:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060682624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099016:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060681856:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099041:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.099057:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060682368:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099071:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.099082:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060682880:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099097:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788839604.099125:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b1880 x1875734060681344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839604.099139:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060681344:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839604.099151:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788839604.099156:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060681984:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099176:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.099494:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060682496:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099514:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839604.099541:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681856 00000100:00100000:0.0:1788839604.099545:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681856 00000100:00100000:0.0:1788839604.099563:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682368 00000100:00100000:0.0:1788839604.099566:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682368 00000100:00100000:0.0:1788839604.099581:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682496 00000100:00100000:0.0:1788839604.099583:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682496 00000100:00100000:0.0:1788839604.099593:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788839604.099597:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060681856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099628:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060681856:12345-0@lo:400:kworker.0 Request processed in 31us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.099633:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788839604.099644:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839604.099649:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060682368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099667:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060682368:12345-0@lo:400:kworker.0 Request processed in 18us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.099671:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788839604.099678:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788839604.099683:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060682496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.099699:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060682496:12345-0@lo:400:kworker.0 Request processed in 17us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.099704:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788839604.099713:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839604.099715:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839604.099721:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681984 00000100:00100000:0.0:1788839604.099723:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681984 00000100:00100000:0.0:1788839604.100439:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788839604.100449:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060681984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.100493:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060681984:12345-0@lo:400:kworker.0 Request processed in 48us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.100508:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788839604.100546:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060681984:0@lo:400:kworker.0 00010000:00080000:0.0:1788839604.100560:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647978000 x1875734060682496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839604.100569:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060682496:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.100580:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060681856:0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.100590:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060682368:0@lo:400:kworker.0 00000100:00100000:2.0:1788839604.100622:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839604.100645:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681600 00000100:00100000:0.0:1788839604.100649:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681600 00000100:00100000:2.0:1788839604.100652:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060681728 00000100:00100000:2.0:1788839604.100655:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060681728 00000100:00080000:2.0:1788839604.100673:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839604.100680:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788839604.100686:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060681600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839604.100697:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839604.100703:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060681472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839604.100717:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060681600:12345-0@lo:400:kworker.0 Request processed in 32us (4787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.100722:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00002000:00000024:2.0:1788839604.100726:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839604.100764:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060681472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (5129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839604.100785:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788839604.100790:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060681600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839604.100798:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839604.100804:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060681728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839604.100813:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788839604.100841:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c75180 x1875734060681472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839604.100842:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060681728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839604.100848:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839604.100856:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060681472:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788839604.100871:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fa680 x1875734060681728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839604.100882:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060682880 00000100:00100000:2.0:1788839604.100884:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060681728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839604.100884:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060682880 00000100:00100000:0.0:1788839604.100908:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788839604.100915:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060682880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839604.100964:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060682880:12345-0@lo:400:kworker.0 Request processed in 49us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839604.100971:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788839604.104471:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647979f80 x1875734060682880/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839604.104492:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060682880:0@lo:400:kworker.0 00000100:00100000:1.0:1788839604.608260:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839604.608285:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060683008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839604.608375:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839604.608445:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683008 00000100:00100000:1.0:1788839604.608469:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683008 00000100:00100000:1.0:1788839604.608517:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839604.608525:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060683008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839604.608559:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839604.608601:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060683008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839604.608608:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839604.608653:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060683008:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788839605.054949:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839605.417918:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839605.417959:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839605.418007:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839605.418074:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121984 00000100:00100000:0.0:1788839605.418084:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121984 00000100:00100000:0.0:1788839605.418149:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122112 00000100:00100000:0.0:1788839605.418152:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122112 00000100:00100000:0.0:1788839605.418171:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1788839605.418180:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050121984:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839605.418255:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050121984:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839605.418264:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1788839605.418265:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050121856 00000100:00100000:3.0:1788839605.418272:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050121856 00000100:00100000:0.0:1788839605.418284:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1788839605.418294:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050122112:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839605.418322:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 289 00000100:00100000:0.0:1788839605.418322:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050122112:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839605.418343:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:3.0:1788839605.418347:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050121856:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839605.418381:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050121856:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839605.418388:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 289 00000100:00080000:2.0:1788839605.418582:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839605.418596:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788839606.081756:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839606.655971:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839606.656004:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060683136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839606.656088:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839606.656705:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683136 00000100:00100000:0.0:1788839606.656714:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683136 00000100:00100000:0.0:1788839606.656802:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788839606.656813:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7479f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060683136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839606.656847:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839606.656903:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7479f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060683136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839606.656910:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788839606.657363:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060683136:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839607.103811:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839608.132933:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839609.156137:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839609.214946:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839609.214988:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060683264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839609.215062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215140:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060683648:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215165:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215186:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060684160:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215208:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215226:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060684672:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215245:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215262:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788839609.215268:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060683776:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215289:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215316:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060684288:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215343:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060684800:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215381:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839609.215414:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684288 00000100:00100000:2.0:1788839609.215421:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684288 00000100:00100000:0.0:1788839609.215428:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060683520:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215450:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215465:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060684032:0@lo:400:kworker.0 00000100:00100000:2.0:1788839609.215467:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684800 00000100:00100000:2.0:1788839609.215470:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684800 00000100:00100000:0.0:1788839609.215483:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839609.215492:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839609.215492:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060684544:0@lo:400:kworker.0 00000100:00100000:2.0:1788839609.215500:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060684288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215512:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215521:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060685056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839609.215537:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839609.215547:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060684288:12345-0@lo:400:kworker.0 Request processed in 48us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.215549:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788839609.215554:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839609.215561:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060683392:0@lo:400:kworker.0 00000100:00100000:2.0:1788839609.215569:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839609.215574:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060684800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215586:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839609.215596:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060684800:12345-0@lo:400:kworker.0 Request processed in 23us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839609.215602:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788839609.215605:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060683904:0@lo:400:kworker.0 00000100:00080000:2.0:1788839609.215616:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839609.215620:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839609.215623:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215638:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060684416:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215657:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215680:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060684928:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215698:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.215728:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683264 00000100:00100000:0.0:1788839609.215732:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683264 00000100:00100000:0.0:1788839609.215755:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685056 00000100:00100000:0.0:1788839609.215758:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685056 00000100:00100000:0.0:1788839609.215787:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788839609.215793:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060683264:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839609.215805:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788839609.215812:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060685056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839609.215812:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788839609.215825:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839609.215841:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060683264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.215848:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839609.215854:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060685056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.215859:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839609.215864:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684160 00000100:00100000:0.0:1788839609.215867:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684160 00000100:00100000:0.0:1788839609.215890:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684672 00000100:00100000:0.0:1788839609.215892:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684672 00000100:00100000:0.0:1788839609.215902:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683776 00000100:00100000:0.0:1788839609.215904:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683776 00000100:00100000:0.0:1788839609.215913:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683520 00000100:00100000:0.0:1788839609.215915:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683520 00000100:00100000:0.0:1788839609.215923:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684032 00000100:00100000:0.0:1788839609.215925:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684032 00000100:00100000:0.0:1788839609.215935:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684544 00000100:00100000:0.0:1788839609.215942:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684544 00000100:00100000:1.0:1788839609.215949:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684416 00000100:00100000:1.0:1788839609.215952:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684416 00000100:00100000:0.0:1788839609.215959:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788839609.215964:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060684160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.215970:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060684928 00000100:00100000:1.0:1788839609.215973:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060684928 00000100:00100000:1.0:1788839609.215986:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839609.215992:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060684416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.215993:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060684160:12345-0@lo:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.215999:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788839609.216010:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788839609.216015:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060684672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216018:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060684416:12345-0@lo:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.216023:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839609.216034:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839609.216035:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060684672:12345-0@lo:400:kworker.0 Request processed in 21us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216040:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839609.216044:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060684928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.216049:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788839609.216053:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060683776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216070:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060684928:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216073:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060683776:12345-0@lo:400:kworker.0 Request processed in 20us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.216076:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839609.216079:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788839609.216087:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788839609.216092:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788839609.216092:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060683520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216098:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060684032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.216115:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060683520:12345-0@lo:400:kworker.0 Request processed in 23us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.216119:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060684032:12345-0@lo:400:kworker.0 Request processed in 22us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216120:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788839609.216125:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788839609.216129:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788839609.216134:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060684544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216150:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060685312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839609.216158:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060684544:12345-0@lo:400:kworker.0 Request processed in 24us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216171:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788839609.216189:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683392 00000100:00100000:0.0:1788839609.216193:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683392 00000100:00100000:0.0:1788839609.216218:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788839609.216223:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060683392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.216251:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060683392:12345-0@lo:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216257:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788839609.216283:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683648 00000100:00100000:0.0:1788839609.216287:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683648 00000100:00100000:0.0:1788839609.216311:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060683904 00000100:00100000:0.0:1788839609.216314:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060683904 00000100:00100000:0.0:1788839609.216328:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788839609.216333:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060683648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.216362:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060683648:12345-0@lo:400:kworker.0 Request processed in 28us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216368:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788839609.216378:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788839609.216383:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060683904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.216411:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060683904:12345-0@lo:400:kworker.0 Request processed in 27us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839609.216416:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1788839609.216437:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839609.216440:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839609.216442:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839609.216444:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839609.216452:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839609.216468:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060683392:0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216470:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839609.216476:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060685184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839609.216487:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060683904:0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216497:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788839609.216498:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9180 x1875734060684416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216508:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060684416:0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216516:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685312 00010000:00080000:0.0:1788839609.216517:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b3480 x1875734060684928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839609.216520:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685312 00000100:00100000:0.0:1788839609.216525:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060684928:0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216535:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685184 00000100:00100000:0.0:1788839609.216535:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060683520:0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216537:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685184 00000100:00100000:0.0:1788839609.216544:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060684032:0@lo:400:kworker.0 00000100:00100000:1.0:1788839609.216547:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839609.216552:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060685312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839609.216553:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060684544:0@lo:400:kworker.0 00010000:00080000:0.0:1788839609.216563:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647b6df80 x1875734060685056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1788839609.216565:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839609.216575:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060685056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839609.216591:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060685312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.216596:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839609.216607:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788839609.216613:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060685184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839609.216631:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839609.216635:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060683776:0@lo:400:kworker.0 00010000:00080000:0.0:1788839609.216645:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb800 x1875734060684288/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216654:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060684288:0@lo:400:kworker.0 00010000:00080000:0.0:1788839609.216663:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b0e00 x1875734060684800/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216669:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060684800:0@lo:400:kworker.0 00000100:00100000:0.0:1788839609.216685:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060683648:0@lo:400:kworker.0 00010000:00080000:0.0:1788839609.216695:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9880 x1875734060684160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216703:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060684160:0@lo:400:kworker.0 00010000:00080000:0.0:1788839609.216712:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b2a00 x1875734060684672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216719:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060684672:0@lo:400:kworker.0 00010000:00080000:0.0:1788839609.216727:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aeea00 x1875734060683264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216736:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060683264:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788839609.216799:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c77100 x1875734060685312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.216809:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060685312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839609.216869:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060685184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 256us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.216876:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788839609.220406:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aedc00 x1875734060685184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839625 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839609.220433:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060685184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839609.729249:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839609.729273:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060685440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839609.729361:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839609.729443:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685440 00000100:00100000:1.0:1788839609.729452:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685440 00000100:00100000:1.0:1788839609.729500:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788839609.729509:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060685440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839609.729542:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839609.729586:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060685440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839609.729593:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788839609.729637:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060685440:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788839610.176498:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839610.535666:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839610.535712:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839610.535752:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839610.535860:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122240 00000100:00100000:0.0:1788839610.535870:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122240 00000100:00100000:0.0:1788839610.535924:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:0.0:1788839610.535934:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050122240:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839610.536006:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050122240:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839610.536033:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:0.0:1788839610.537842:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122496 00000100:00100000:0.0:1788839610.537857:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122496 00000100:00100000:0.0:1788839610.537925:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122368 00000100:00100000:0.0:1788839610.537928:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122368 00000100:00100000:0.0:1788839610.537958:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:0.0:1788839610.537967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050122496:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839610.538037:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050122496:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 71us (2324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839610.538044:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:0.0:1788839610.538060:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1788839610.538065:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050122368:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839610.538086:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050122368:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839610.538092:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00080000:0.0:1788839610.538107:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839610.538110:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788839611.202338:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839611.778100:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060685568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839611.778170:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839611.780896:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685568 00000100:00100000:0.0:1788839611.780911:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685568 00000100:00100000:0.0:1788839611.780983:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788839611.780994:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060685568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839611.781030:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839611.781121:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060685568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 129us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839611.781128:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788839611.781450:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060685568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839612.228978:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839613.247529:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839614.270970:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839614.338682:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060685824:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.338752:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.338828:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060686336:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.338848:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.338870:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060686848:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.338899:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.338938:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788839614.338944:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060685696:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.338972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.338991:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060686208:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339129:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339152:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060686720:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339176:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339191:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060687232:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339210:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339234:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060685952:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339256:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339294:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060686464:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339324:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339341:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060686976:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339364:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339377:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788839614.339382:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060686080:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339403:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339413:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060686592:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339429:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339442:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060687104:0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339457:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.339489:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685824 00000100:00100000:2.0:1788839614.339497:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685824 00000100:00100000:2.0:1788839614.339532:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686336 00000100:00100000:2.0:1788839614.339542:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686336 00000100:00100000:2.0:1788839614.339566:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686848 00000100:00100000:2.0:1788839614.339568:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686848 00000100:00100000:2.0:1788839614.339581:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686464 00000100:00100000:2.0:1788839614.339583:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686464 00000100:00100000:2.0:1788839614.339592:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686976 00000100:00100000:2.0:1788839614.339594:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686976 00000100:00100000:2.0:1788839614.339601:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686080 00000100:00100000:2.0:1788839614.339603:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686080 00000100:00100000:2.0:1788839614.339614:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788839614.339620:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060685824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339672:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060685824:12345-0@lo:400:kworker.0 Request processed in 51us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.339678:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788839614.339693:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788839614.339699:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060686336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339720:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060686336:12345-0@lo:400:kworker.0 Request processed in 22us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.339725:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788839614.339735:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788839614.339740:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060686848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339760:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060686848:12345-0@lo:400:kworker.0 Request processed in 21us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.339765:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788839614.339799:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788839614.339805:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060686464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.339836:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060686464:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.339851:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788839614.339863:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788839614.339869:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060686976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.340545:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060686976:12345-0@lo:400:kworker.0 Request processed in 674us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.340553:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788839614.340570:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788839614.340576:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060686080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.340607:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060686080:12345-0@lo:400:kworker.0 Request processed in 32us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.340613:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788839614.340640:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685696 00000100:00100000:2.0:1788839614.340645:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685696 00000100:00100000:2.0:1788839614.340676:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788839614.340682:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060685696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.340712:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060685696:12345-0@lo:400:kworker.0 Request processed in 30us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.340717:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788839614.340745:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686208 00000100:00100000:2.0:1788839614.340750:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686208 00000100:00100000:2.0:1788839614.340765:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060685952 00000100:00100000:2.0:1788839614.340788:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060685952 00000100:00100000:2.0:1788839614.340804:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839614.340809:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060686208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839614.340843:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060686208:12345-0@lo:400:kworker.0 Request processed in 33us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.340860:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839614.340873:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839614.340878:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060685952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839614.341288:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839614.341592:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060687360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839614.341631:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839614.341680:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686720 00000100:00100000:1.0:1788839614.341685:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686720 00000100:00100000:1.0:1788839614.341719:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687232 00000100:00100000:1.0:1788839614.341723:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687232 00000100:00100000:1.0:1788839614.341736:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060686592 00000100:00100000:1.0:1788839614.341738:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060686592 00000100:00100000:1.0:1788839614.341764:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687104 00000100:00100000:1.0:1788839614.341797:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687104 00000100:00100000:1.0:1788839614.341815:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839614.341821:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060686720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839614.341859:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060686720:12345-0@lo:400:kworker.0 Request processed in 38us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839614.341865:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839614.341877:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839614.343117:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060687232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839614.343171:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060687232:12345-0@lo:400:kworker.0 Request processed in 1288us (3959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839614.343179:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839614.343200:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839614.343206:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060686592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839614.343234:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060686592:12345-0@lo:400:kworker.0 Request processed in 29us (3803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839614.343239:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839614.343250:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839614.343255:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060687104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839614.343293:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060687104:12345-0@lo:400:kworker.0 Request processed in 38us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839614.343299:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839614.343459:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060685952:12345-0@lo:400:kworker.0 Request processed in 2580us (4200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.343466:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788839614.343498:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839614.343502:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839614.343505:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839614.343507:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839614.343557:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060687616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839614.343591:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.343623:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839614.343629:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060687488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839614.343673:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839614.343705:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687360 00000100:00100000:2.0:1788839614.343712:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687360 00000100:00100000:2.0:1788839614.343737:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687616 00000100:00100000:2.0:1788839614.343740:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687616 00000100:00100000:2.0:1788839614.343751:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687488 00000100:00100000:2.0:1788839614.343753:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687488 00000100:00100000:2.0:1788839614.343764:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839614.343795:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060687360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839614.343817:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839614.343851:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060687360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.343857:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839614.343875:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788839614.343996:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839614.344006:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060687488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839614.344030:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839614.344068:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060687488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.344074:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788839614.344998:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060687744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839614.345110:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839614.345154:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486cb800 x1875734060687360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839614.345187:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060687360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839614.345219:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687744 00000100:00100000:1.0:1788839614.345224:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687744 00000100:00100000:1.0:1788839614.345249:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788839614.345255:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060687744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788839614.345283:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839614.345985:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060687616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839614.346002:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839614.346234:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060687616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2351us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.346242:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788839614.346292:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486c8a80 x1875734060687488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839614.346309:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060687488:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788839614.346321:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c74000 x1875734060687616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839614.346332:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060687616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839614.351655:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060687744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6389us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839614.351671:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788839614.351940:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e3a300 x1875734060687744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839614.351962:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060687744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839614.353068:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060685696:0@lo:400:kworker.0 00000100:00100000:0.0:1788839614.353088:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060686208:0@lo:400:kworker.0 00010000:00080000:0.0:1788839614.353102:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819faa00 x1875734060686720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839614.353113:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060686720:0@lo:400:kworker.0 00010000:00080000:0.0:1788839614.353126:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb480 x1875734060687232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839614.353134:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060687232:0@lo:400:kworker.0 00000100:00100000:0.0:1788839614.353147:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060685824:0@lo:400:kworker.0 00000100:00100000:0.0:1788839614.353158:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060686336:0@lo:400:kworker.0 00000100:00100000:0.0:1788839614.353168:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060686848:0@lo:400:kworker.0 00000100:00100000:3.0:1788839614.360409:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060686080:0@lo:400:kworker.0 00010000:00080000:3.0:1788839614.360432:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fa300 x1875734060686592/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839614.360442:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060686592:0@lo:400:kworker.0 00010000:00080000:3.0:1788839614.360454:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fa680 x1875734060687104/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839614.360462:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060687104:0@lo:400:kworker.0 00000100:00100000:3.0:1788839614.360553:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060685952:0@lo:400:kworker.0 00010000:00080000:3.0:1788839614.360566:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb800 x1875734060686464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839614.360573:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060686464:0@lo:400:kworker.0 00010000:00080000:3.0:1788839614.360583:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9180 x1875734060686976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839614.360592:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060686976:0@lo:400:kworker.0 00000001:02000400:0.0:1788839614.456284:0:11965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:53:31 (1788839611) === 00000100:00100000:3.0:1788839614.822459:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.822606:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122624 00000100:00100000:0.0:1788839614.822632:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122624 00000100:00100000:0.0:1788839614.822696:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 293 00000100:00100000:0.0:1788839614.822706:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+10:8734:x1875734050122624:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839614.822724:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839614.822742:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078e00/0xad5b343a26572c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74744 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839614.822812:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078e00/0xad5b343a26572c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74744 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839614.822824:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078e00/0xad5b343a26572c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74744 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839614.822832:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078e00, rc 0) 00000100:00100000:0.0:1788839614.822889:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:8734:x1875734050122624:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 185us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.822896:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 293 00000100:00100000:0.0:1788839614.829592:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839614.829688:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122752 00000100:00100000:3.0:1788839614.829698:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122752 00000100:00100000:3.0:1788839614.829762:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:3.0:1788839614.829799:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+11:8734:x1875734050122752:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788839614.829969:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+11:8734:x1875734050122752:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 198us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839614.829977:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:1.0:1788839614.836370:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.836561:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050122880 00000100:00100000:2.0:1788839614.836571:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050122880 00000100:00100000:2.0:1788839614.836728:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:2.0:1788839614.836737:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+11:8734:x1875734050122880:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788839614.836955:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+11:8734:x1875734050122880:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 217us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.836965:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:3.0:1788839614.839342:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.839435:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123008 00000100:00100000:0.0:1788839614.839444:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123008 00000100:00100000:0.0:1788839614.839494:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:0.0:1788839614.839503:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:8738:x1875734050123008:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839614.839666:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:8738:x1875734050123008:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 163us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.839674:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:0.0:1788839614.847060:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060687872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839614.847134:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839614.847291:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060687872 00000100:00100000:1.0:1788839614.847300:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060687872 00000100:00100000:1.0:1788839614.847355:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788839614.847365:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060687872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839614.847400:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839614.847453:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060687872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839614.847461:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788839614.847765:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060687872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839614.856929:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839614.857010:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123136 00000100:00100000:3.0:1788839614.857019:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123136 00000100:00100000:3.0:1788839614.857113:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:3.0:1788839614.857125:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+11:8738:x1875734050123136:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839614.857316:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+11:8738:x1875734050123136:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 193us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839614.857334:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:1.0:1788839614.865170:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.865357:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123264 00000100:00100000:2.0:1788839614.865371:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123264 00000100:00100000:2.0:1788839614.865533:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:2.0:1788839614.865544:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+11:8738:x1875734050123264:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839614.865929:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+11:8738:x1875734050123264:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 386us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.865944:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:0.0:1788839614.868465:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839614.868584:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123392 00000100:00100000:3.0:1788839614.868608:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123392 00000100:00100000:3.0:1788839614.868662:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:3.0:1788839614.868673:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+11:8734:x1875734050123392:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788839614.868691:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839614.868710:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6000/0xad5b343a26572c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74775 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839614.868738:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6000/0xad5b343a26572c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74775 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839614.868750:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6000/0xad5b343a26572c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74775 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839614.868757:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6000, rc 0) 00000100:00100000:3.0:1788839614.868920:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:8734:x1875734050123392:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 247us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839614.868927:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:0.0:1788839614.876058:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.876112:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123520 00000100:00100000:2.0:1788839614.876122:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123520 00000100:00100000:2.0:1788839614.876174:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:2.0:1788839614.876184:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:8734:x1875734050123520:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788839614.876208:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788839614.876232:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788839614.876236:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788839614.876239:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788839614.876242:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788839614.876244:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788839614.877582:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:8734:x1875734050123520:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 1391us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.877605:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:1.0:1788839614.879982:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.880308:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123648 00000100:00100000:0.0:1788839614.880318:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123648 00000100:00100000:0.0:1788839614.880412:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:0.0:1788839614.880423:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+12:8734:x1875734050123648:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839614.880440:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839614.880459:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7477c expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839614.880491:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839614.880503:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839614.880512:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078a00, rc 0) 00000100:00100000:0.0:1788839614.880577:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:8734:x1875734050123648:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 156us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.880584:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:1.0:1788839614.882157:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.882317:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123776 00000100:00100000:0.0:1788839614.882328:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123776 00000100:00100000:0.0:1788839614.882423:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 302 00000100:00100000:0.0:1788839614.882433:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:8734:x1875734050123776:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788839614.882645:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:8734:x1875734050123776:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 159us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.882655:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 302 00000100:00100000:2.0:1788839614.884529:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.884714:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050123904 00000100:00100000:0.0:1788839614.884722:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050123904 00000100:00100000:0.0:1788839614.884828:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 303 00000100:00100000:0.0:1788839614.884838:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:8734:x1875734050123904:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788839614.884960:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:8734:x1875734050123904:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 123us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.884968:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 303 00000100:00100000:1.0:1788839614.888077:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.888204:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124032 00000100:00100000:0.0:1788839614.888213:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124032 00000100:00100000:0.0:1788839614.888353:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 304 00000100:00100000:0.0:1788839614.888364:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:8743:x1875734050124032:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839614.888715:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:8743:x1875734050124032:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 352us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.888724:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 304 00000100:00100000:1.0:1788839614.893967:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.894073:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124160 00000100:00100000:0.0:1788839614.894083:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124160 00000100:00100000:0.0:1788839614.894144:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:0.0:1788839614.894154:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:8743:x1875734050124160:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839614.894326:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:8743:x1875734050124160:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 173us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.894334:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:2.0:1788839614.903080:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.903124:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.903155:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.903188:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.903225:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124288 00000100:00100000:3.0:1788839614.903227:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124544 00000100:00100000:3.0:1788839614.903236:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124544 00000100:00100000:2.0:1788839614.903236:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124288 00000100:00100000:2.0:1788839614.903282:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124928 00000100:00100000:2.0:1788839614.903285:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124928 00000100:00100000:3.0:1788839614.903291:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125056 00000100:00100000:3.0:1788839614.903294:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125056 00000100:00100000:2.0:1788839614.903330:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:2.0:1788839614.903340:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050124928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839614.903352:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788839614.903358:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1875734050124544:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788839614.903394:0:6488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 369e11fa-e360-4215-b9ed-184f44a2087d@192.168.203.52@tcp t0 exp 0000000000000000 cur 269 last 0 00000100:00100000:2.0:1788839614.903413:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050124928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.903419:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000020:00000080:0.0:1788839614.903431:0:6488:0:(genops.c:1385:class_connect()) connect: client 369e11fa-e360-4215-b9ed-184f44a2087d, cookie 0xad5b343a26572c1e 00000100:00100000:2.0:1788839614.903436:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788839614.903439:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1875734050124288:12345-192.168.203.52@tcp:38:mount.lustre.0 00000004:00100000:0.0:1788839614.903455:0:6488:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00010000:00080000:2.0:1788839614.903466:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 369e11fa-e360-4215-b9ed-184f44a2087d@192.168.203.52@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:2.0:1788839614.903486:0:6489:0:(genops.c:1385:class_connect()) connect: client 369e11fa-e360-4215-b9ed-184f44a2087d, cookie 0xad5b343a26572c25 00000004:00100000:2.0:1788839614.903497:0:6489:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788839614.903566:0:6489:0:(import.c:65:import_set_state_nolock()) ffff8ab647b12800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788839614.903566:0:6488:0:(import.c:65:import_set_state_nolock()) ffff8ab777c24000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839614.903605:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:2388:x1875734050124288:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 161us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.903613:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788839614.908700:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:3.0:1788839614.908714:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050125056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:2.0:1788839614.908947:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839614.908953:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839614.909100:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2388:x1875734050124544:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 5737us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.909111:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1788839614.909450:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050125056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 739us (6259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.909459:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:2.0:1788839614.912577:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.912622:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.912710:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839614.912806:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124416 00000100:00100000:3.0:1788839614.912815:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124416 00000100:00100000:3.0:1788839614.912893:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124672 00000100:00100000:3.0:1788839614.912897:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124672 00000100:00100000:3.0:1788839614.912914:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050124800 00000100:00100000:3.0:1788839614.912916:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050124800 00000100:00100000:3.0:1788839614.912929:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788839614.912939:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+7:0:x1875734050124416:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788839614.912969:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839614.913047:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+7:0:x1875734050124416:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 108us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839614.913054:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788839614.913070:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788839614.913076:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:0:x1875734050124672:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788839614.913093:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839614.913128:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:0:x1875734050124672:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 52us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839614.913134:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788839614.913146:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1788839614.913157:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050124800:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788839614.913167:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839614.913188:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050124800:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 36us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839614.913195:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00080000:2.0:1788839614.914154:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839614.914160:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839614.915535:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.915850:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125184 00000100:00100000:0.0:1788839614.915860:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125184 00000100:00100000:0.0:1788839614.915956:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788839614.915967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050125184:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788839614.916054:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050125184:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 89us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.916061:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788839614.918211:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839614.918247:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839614.918315:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839614.918438:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125312 00000100:00100000:2.0:1788839614.918447:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125312 00000100:00100000:2.0:1788839614.918483:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125440 00000100:00100000:2.0:1788839614.918486:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125440 00000100:00100000:2.0:1788839614.918503:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788839614.918510:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1875734050125312:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788839614.918541:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 369e11fa-e360-4215-b9ed-184f44a2087d@192.168.203.52@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:2.0:1788839614.918575:0:8405:0:(genops.c:1385:class_connect()) connect: client 369e11fa-e360-4215-b9ed-184f44a2087d, cookie 0xad5b343a26572c2c 00002000:00100000:2.0:1788839614.918587:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 369e11fa-e360-4215-b9ed-184f44a2087d/ffff8ab647b10800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839614.918619:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788839614.918706:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788839614.918737:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab647b12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839614.918820:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:2388:x1875734050125312:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 309us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.918827:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788839614.918843:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788839614.918847:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2388:x1875734050125440:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788839614.918862:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 369e11fa-e360-4215-b9ed-184f44a2087d@192.168.203.52@tcp t0 exp 0000000000000000 cur 269 last 0 00000020:00000080:2.0:1788839614.918877:0:8405:0:(genops.c:1385:class_connect()) connect: client 369e11fa-e360-4215-b9ed-184f44a2087d, cookie 0xad5b343a26572c33 00002000:00100000:2.0:1788839614.918882:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 369e11fa-e360-4215-b9ed-184f44a2087d/ffff8ab647b15800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788839614.918992:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125568 00000100:00100000:0.0:1788839614.918997:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125568 00000100:00100000:0.0:1788839614.919033:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1788839614.919041:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050125568:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788839614.919083:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050125568:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 43us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.919091:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00002000:00100000:2.0:1788839614.919643:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788839614.919702:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788839614.919723:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab647b13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839614.919754:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:2388:x1875734050125440:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 904us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839614.919761:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788839614.922182:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839614.922347:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125696 00000100:00100000:0.0:1788839614.922356:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125696 00000100:00100000:0.0:1788839614.922449:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788839614.922458:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050125696:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788839614.922550:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788839614.922628:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:8734:x1875734050125696:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 171us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839614.922636:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00010000:00010000:2.0:1788839615.295218:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839616.318987:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839616.897995:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060688000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839616.898072:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839616.898146:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688000 00000100:00100000:3.0:1788839616.898174:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688000 00000100:00100000:3.0:1788839616.898238:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788839616.898247:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060688000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839616.898291:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839616.898337:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060688000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839616.898345:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788839616.898389:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060688000:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839617.345426:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839618.367382:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839619.392318:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839619.455532:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060688256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839619.455609:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839619.455796:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688256 00000100:00100000:1.0:1788839619.455803:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688256 00000100:00100000:1.0:1788839619.455870:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839619.455881:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060688256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839619.455908:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839619.455967:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060688256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.455974:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788839619.456129:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060688128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839619.456164:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839619.457195:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839619.457244:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688128 00000100:00100000:2.0:1788839619.457252:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688128 00000100:00100000:2.0:1788839619.457306:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839619.457315:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060688128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839619.457350:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839619.457422:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060688128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839619.457429:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:2.0:1788839619.457489:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed180 x1875734060688256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839619.457509:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060688256:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788839619.457861:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788839619.457902:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b3b80 x1875734060688128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839619.457920:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060688128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839619.458001:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060688512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839619.458049:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839619.458091:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060688384:0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.458093:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060689024:0@lo:400:kworker.0 00000100:00100000:3.0:1788839619.458138:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839619.458157:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839619.458169:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060688896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.458185:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060689536:0@lo:400:kworker.0 00000100:00100000:3.0:1788839619.458200:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839619.458219:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839619.458254:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788839619.458261:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060688640:0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.458283:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839619.458300:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060689152:0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.458320:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839619.458335:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060689664:0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.458355:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839619.458376:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688384 00000100:00100000:0.0:1788839619.458392:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688384 00000100:00100000:0.0:1788839619.458426:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788839619.458434:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060688384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.458478:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060688384:12345-0@lo:400:kworker.0 Request processed in 44us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839619.458494:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788839619.458539:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688896 00000100:00100000:0.0:1788839619.458543:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688896 00000100:00100000:0.0:1788839619.458562:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689536 00000100:00100000:0.0:1788839619.458564:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689536 00000100:00100000:0.0:1788839619.458584:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688640 00000100:00100000:0.0:1788839619.458587:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688640 00000100:00100000:0.0:1788839619.458597:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689152 00000100:00100000:0.0:1788839619.458599:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689152 00000100:00100000:0.0:1788839619.458608:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689664 00000100:00100000:0.0:1788839619.458609:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689664 00000100:00100000:0.0:1788839619.458621:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788839619.458626:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060688896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.458735:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688512 00000100:00100000:1.0:1788839619.458740:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688512 00000100:00100000:1.0:1788839619.458765:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839619.458792:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060688512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839619.458806:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839619.458845:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060688512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.458851:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839619.458906:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788839619.458914:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060689536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.458945:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060689536:12345-0@lo:400:kworker.0 Request processed in 32us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.458951:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788839619.458968:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839619.458974:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060688640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.459000:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060688640:12345-0@lo:400:kworker.0 Request processed in 27us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.459012:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839619.459025:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788839619.459031:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060689152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.459059:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060689152:12345-0@lo:400:kworker.0 Request processed in 28us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.459065:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788839619.459075:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788839619.459080:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060689664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.459103:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060689664:12345-0@lo:400:kworker.0 Request processed in 23us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.459108:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788839619.459133:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839619.459137:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839619.459139:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839619.459166:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060688640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.459176:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060689152:0@lo:400:kworker.0 00010000:00080000:1.0:1788839619.459185:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e679500 x1875734060689664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839619.459195:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e679500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060689664:0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.459204:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060689536:0@lo:400:kworker.0 00010000:00080000:1.0:1788839619.459213:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486cb480 x1875734060688512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839619.459247:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060688512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839619.461065:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060688896:12345-0@lo:400:kworker.0 Request processed in 2429us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839619.461080:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788839619.461300:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060688768:0@lo:400:kworker.0 00000100:00100000:2.0:1788839619.461364:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839619.461410:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060689280:0@lo:400:kworker.0 00000100:00100000:2.0:1788839619.461433:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839619.461466:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060689792:0@lo:400:kworker.0 00000100:00100000:2.0:1788839619.461490:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839619.461513:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839619.461518:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060689920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839619.461808:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839619.461845:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689024 00000100:00100000:2.0:1788839619.461852:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689024 00000100:00100000:2.0:1788839619.461887:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060688768 00000100:00100000:2.0:1788839619.461889:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060688768 00000100:00100000:2.0:1788839619.461906:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788839619.461912:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060689024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839619.462004:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060689024:12345-0@lo:400:kworker.0 Request processed in 91us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839619.462011:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788839619.462026:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788839619.462033:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060688768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839619.462065:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060688768:12345-0@lo:400:kworker.0 Request processed in 33us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839619.462071:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788839619.462091:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689792 00000100:00100000:2.0:1788839619.462095:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689792 00000100:00100000:2.0:1788839619.462131:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839619.462138:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060689792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.462361:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689920 00000100:00100000:0.0:1788839619.462366:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689920 00000100:00100000:0.0:1788839619.462407:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839619.462414:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060689920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839619.462429:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839619.463790:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060689920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1370us (1976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839619.463802:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839619.463840:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689280 00000100:00100000:0.0:1788839619.463846:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689280 00000100:00100000:0.0:1788839619.463893:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788839619.463901:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060689280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839619.463985:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060689280:12345-0@lo:400:kworker.0 Request processed in 84us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839619.463990:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788839619.464032:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060689024:0@lo:400:kworker.0 00000100:00080000:0.0:1788839619.464097:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839619.464102:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788839619.464125:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b3480 x1875734060689920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839619.464144:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060689920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839619.464333:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060689792:12345-0@lo:400:kworker.0 Request processed in 2194us (2840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839619.464341:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839619.465800:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060688768:0@lo:400:kworker.0 00010000:00080000:0.0:1788839619.465825:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4c380 x1875734060689280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839619.465835:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060689280:0@lo:400:kworker.0 00010000:00080000:0.0:1788839619.465845:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e679c00 x1875734060689792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839619.465853:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e679c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060689792:0@lo:400:kworker.0 00000100:00100000:3.0:1788839619.470119:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060688896:0@lo:400:kworker.0 00000100:00100000:3.0:1788839619.470136:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060689408:0@lo:400:kworker.0 00000100:00100000:3.0:1788839619.470204:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839619.470291:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060688384:0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.470506:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060689408 00000100:00100000:1.0:1788839619.470514:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060689408 00000100:00100000:1.0:1788839619.470566:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839619.470575:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060689408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839619.470645:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060689408:12345-0@lo:400:kworker.0 Request processed in 71us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839619.470653:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788839619.472319:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4f480 x1875734060689408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839619.472335:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060689408:0@lo:400:kworker.0 00000100:00100000:3.0:1788839619.967259:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839619.967284:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060690048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839619.967376:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839619.967438:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690048 00000100:00100000:2.0:1788839619.967448:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690048 00000100:00100000:2.0:1788839619.967505:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788839619.967515:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060690048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839619.967551:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788839619.967608:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e679180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060690048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839619.967615:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839619.969211:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060690048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839620.276752:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839620.278603:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839620.278652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839620.278722:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839620.278746:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839620.278983:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125824 00000100:00100000:0.0:1788839620.279091:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125824 00000100:00100000:0.0:1788839620.279301:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:0.0:1788839620.279311:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050125824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839620.279405:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050125824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 97us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839620.279412:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:3.0:1788839620.280093:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126464 00000100:00100000:3.0:1788839620.280107:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126464 00000100:00100000:3.0:1788839620.280597:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788839620.280607:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839620.280657:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 53us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839620.280664:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00080000:0.0:1788839620.280786:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839620.281518:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050125952 00000100:00100000:1.0:1788839620.281528:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050125952 00000100:00100000:1.0:1788839620.281578:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126208 00000100:00100000:1.0:1788839620.281581:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126208 00000100:00100000:1.0:1788839620.282073:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126080 00000100:00100000:1.0:1788839620.282079:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126080 00000100:00100000:1.0:1788839620.282121:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1788839620.282134:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050125952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839620.282143:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839620.282195:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050125952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 65us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839620.282202:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1788839620.282216:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126336 00000100:00100000:1.0:1788839620.282220:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126336 00000100:00100000:1.0:1788839620.282254:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:1.0:1788839620.282262:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839620.282296:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839620.282304:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839620.282309:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:1.0:1788839620.282325:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:1.0:1788839620.282334:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050126080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839620.282364:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126592 00000100:00100000:2.0:1788839620.282369:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126592 00000100:00100000:1.0:1788839620.282380:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050126080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 47us (3632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839620.282388:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:1.0:1788839620.282402:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:1.0:1788839620.282409:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839620.282425:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788839620.282432:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839620.282439:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839620.282444:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:2.0:1788839620.282477:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2391:x1875734050126592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839620.282484:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00080000:2.0:1788839620.282532:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839620.282537:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839620.282541:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788839620.415284:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788839620.996200:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00100000:3.0:1788839621.013391:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00100000:2.0:1788839621.014254:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00100000:1.0:1788839621.017060:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00010000:00010000:2.0:1788839621.445141:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839622.015059:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060690176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839622.015135:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839622.015515:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690176 00000100:00100000:2.0:1788839622.015640:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690176 00000100:00100000:2.0:1788839622.015699:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788839622.015708:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060690176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839622.015742:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839622.016717:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060690176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1007us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839622.016727:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788839622.016872:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060690176:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788839622.104006:0:12158:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1788839622.463129:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839623.491430:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839624.518915:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839624.575315:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060690304:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839624.575395:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839624.577433:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690304 00000100:00100000:2.0:1788839624.577464:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690304 00000100:00100000:2.0:1788839624.577540:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788839624.577554:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77fba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060690304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839624.577595:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839624.577666:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77fba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060690304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839624.577673:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788839624.579486:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060690560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839624.579539:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839624.579601:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690560 00000100:00100000:1.0:1788839624.579615:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690560 00000100:00100000:1.0:1788839624.579655:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839624.579663:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060690560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839624.579686:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839624.579725:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060690560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839624.579732:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788839624.579766:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eefb80 x1875734060690560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839624.579800:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060690560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839624.580068:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060690432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839624.580099:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580157:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060690688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839624.580179:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580416:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060690944:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.580443:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580461:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060691456:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.580480:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580513:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788839624.580519:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060690816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.580544:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060691328:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.580765:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580811:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060691840:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.580833:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.580858:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690944 00000100:00100000:3.0:1788839624.580862:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690944 00000100:00100000:3.0:1788839624.580893:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691456 00000100:00100000:3.0:1788839624.580896:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691456 00000100:00100000:3.0:1788839624.580910:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691840 00000100:00100000:3.0:1788839624.580912:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691840 00000100:00100000:3.0:1788839624.580923:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788839624.580929:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060690944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.580965:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060690944:12345-0@lo:400:kworker.0 Request processed in 36us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839624.580971:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788839624.580984:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788839624.580990:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060691456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581014:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060691456:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839624.581020:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788839624.581031:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839624.581037:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060691840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581063:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060691840:12345-0@lo:400:kworker.0 Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839624.581078:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839624.581106:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690816 00000100:00100000:3.0:1788839624.581110:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690816 00000100:00100000:3.0:1788839624.581136:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788839624.581142:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060690816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581170:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060690816:12345-0@lo:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839624.581176:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788839624.581223:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691328 00000100:00100000:3.0:1788839624.581227:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691328 00000100:00100000:3.0:1788839624.581252:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788839624.581258:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060691328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581287:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060691328:12345-0@lo:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839624.581293:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788839624.581325:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060691200:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581347:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.581363:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060691712:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581381:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.581395:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839624.581400:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060691072:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581418:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.581431:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060691584:0@lo:400:kworker.0 00000100:00100000:3.0:1788839624.581448:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839624.581468:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691200 00000100:00100000:3.0:1788839624.581477:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691200 00000100:00100000:3.0:1788839624.581498:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691712 00000100:00100000:3.0:1788839624.581501:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691712 00000100:00100000:3.0:1788839624.581515:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691584 00000100:00100000:3.0:1788839624.581517:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691584 00000100:00100000:3.0:1788839624.581529:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788839624.581535:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060691200:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788839624.582163:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839624.582168:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839624.582171:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839624.582173:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839624.582194:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690432 00000100:00100000:0.0:1788839624.582207:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690432 00000100:00100000:0.0:1788839624.582238:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060690688 00000100:00100000:0.0:1788839624.582241:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060690688 00000100:00100000:0.0:1788839624.582256:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839624.582263:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060690432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839624.582278:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839624.582315:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e678380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060690432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839624.582321:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788839624.582332:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788839624.582338:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060690688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839624.582348:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839624.582370:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e678700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060690688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839624.582375:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:0.0:1788839624.582395:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839624.582397:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788839624.582425:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d4a300 x1875734060690304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839624.582444:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060690304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839624.583171:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839624.583206:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060691712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583254:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060691712:12345-0@lo:400:kworker.0 Request processed in 74us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839624.583260:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839624.583278:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839624.583285:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060691584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583311:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060691584:12345-0@lo:400:kworker.0 Request processed in 28us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839624.583316:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839624.583353:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060690816:0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583364:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e679f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060691328:0@lo:400:kworker.0 00010000:00080000:2.0:1788839624.583376:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e67b480 x1875734060691840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839624.583386:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060691840:0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583397:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060690944:0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583407:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060691456:0@lo:400:kworker.0 00010000:00080000:2.0:1788839624.583430:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eeca80 x1875734060690432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839624.583444:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060690432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839624.583495:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691072 00000100:00100000:2.0:1788839624.583501:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691072 00000100:00100000:2.0:1788839624.583540:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788839624.583547:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060691072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583590:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060691072:12345-0@lo:400:kworker.0 Request processed in 44us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839624.583595:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788839624.583814:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060691072:0@lo:400:kworker.0 00010000:00080000:2.0:1788839624.583824:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e67bb80 x1875734060691584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839640 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839624.583832:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060691584:0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583842:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060691200:0@lo:400:kworker.0 00000100:00100000:2.0:1788839624.583850:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060691712:0@lo:400:kworker.0 00010000:00080000:2.0:1788839624.583861:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e67ad80 x1875734060690688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839640 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839624.583874:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060690688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839624.584517:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060691200:12345-0@lo:400:kworker.0 Request processed in 34us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839624.584527:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788839625.089661:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060691968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839625.089733:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839625.090616:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060691968 00000100:00100000:3.0:1788839625.090627:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060691968 00000100:00100000:3.0:1788839625.090686:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788839625.090696:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060691968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839625.090730:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839625.090815:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060691968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839625.090823:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788839625.090975:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060691968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839625.384613:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839625.384668:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839625.384741:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126848 00000100:00100000:3.0:1788839625.384751:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126848 00000100:00100000:3.0:1788839625.384840:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1788839625.384851:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050126848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839625.384916:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050126848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839625.384924:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00080000:1.0:1788839625.385100:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839625.385144:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126720 00000100:00100000:0.0:1788839625.385149:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126720 00000100:00100000:0.0:1788839625.385174:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:0.0:1788839625.385198:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050126720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839625.385240:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050126720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839625.385247:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:2.0:1788839625.389029:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839625.389074:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839625.389093:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839625.389125:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839625.389158:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127360 00000100:00100000:2.0:1788839625.389168:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127360 00000100:00100000:2.0:1788839625.389245:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788839625.389255:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050127360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839625.389378:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050126976 00000100:00100000:1.0:1788839625.389397:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050126976 00000100:00100000:1.0:1788839625.389424:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127104 00000100:00100000:1.0:1788839625.389427:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127104 00000100:00100000:1.0:1788839625.389441:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127232 00000100:00100000:1.0:1788839625.389443:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127232 00000100:00100000:1.0:1788839625.389456:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:1.0:1788839625.389462:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050126976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839625.389516:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050127360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 262us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839625.389523:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788839625.389549:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:2.0:1788839625.389555:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050127104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839625.389615:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788839625.389625:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788839625.389732:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:3.0:1788839625.389747:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050127232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:0.0:1788839625.390595:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839625.390602:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839625.390604:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839625.391538:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050126976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 2067us (2510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839625.391551:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:2.0:1788839625.392894:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050127104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 3330us (3811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839625.392906:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:3.0:1788839625.393329:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050127232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 3582us (4232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839625.393339:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:1.0:1788839625.397764:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839625.399820:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127488 00000100:00100000:3.0:1788839625.399837:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127488 00000100:00100000:3.0:1788839625.399912:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788839625.399923:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050127488:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839625.400004:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050127488:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839625.400011:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00080000:0.0:1788839625.400876:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788839625.536542:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839626.558944:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839627.138059:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060692096:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839627.138127:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839627.138228:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692096 00000100:00100000:3.0:1788839627.138235:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692096 00000100:00100000:3.0:1788839627.138282:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788839627.138291:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060692096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839627.138325:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839627.138370:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060692096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839627.138377:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788839627.138418:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060692096:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839627.583073:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839628.612779:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839629.634069:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839629.695092:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060692224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839629.695185:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839629.695288:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692224 00000100:00100000:0.0:1788839629.695296:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692224 00000100:00100000:0.0:1788839629.695358:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788839629.695370:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060692224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839629.695403:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839629.698922:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060692352:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839629.698996:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839629.699052:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839629.699058:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060692480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839629.699081:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839629.699117:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692352 00000100:00100000:2.0:1788839629.699131:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692352 00000100:00100000:2.0:1788839629.699178:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692480 00000100:00100000:2.0:1788839629.699182:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692480 00000100:00100000:2.0:1788839629.699201:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788839629.699209:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060692352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839629.699239:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839629.699280:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060692352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.699287:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788839629.699302:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788839629.699308:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060692480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839629.699317:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839629.699342:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060692480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.699348:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788839629.699381:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d4b800 x1875734060692480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839629.699399:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060692480:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788839629.699410:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d48a80 x1875734060692352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839629.699420:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060692352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839629.702228:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060692224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6855us (7036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839629.702242:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788839629.702282:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060692608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839629.702336:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839629.702433:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839629.702439:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839629.703133:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060693120:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703183:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839629.703205:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060693632:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703226:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839629.703253:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788839629.703259:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060692736:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703287:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839629.703309:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060693248:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703331:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839629.703350:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060693760:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703368:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839629.703396:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693120 00000100:00100000:0.0:1788839629.703403:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693120 00000100:00100000:0.0:1788839629.703444:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693632 00000100:00100000:0.0:1788839629.703448:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693632 00000100:00100000:0.0:1788839629.703476:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693760 00000100:00100000:0.0:1788839629.703479:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693760 00000100:00100000:0.0:1788839629.703497:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788839629.703505:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060693120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703558:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060693120:12345-0@lo:400:kworker.0 Request processed in 54us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839629.703565:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788839629.703580:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788839629.703586:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060693632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703613:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060693632:12345-0@lo:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839629.703627:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788839629.703638:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788839629.703725:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060693760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703754:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060693760:12345-0@lo:400:kworker.0 Request processed in 32us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839629.703760:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788839629.703803:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692736 00000100:00100000:0.0:1788839629.703806:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692736 00000100:00100000:0.0:1788839629.703840:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788839629.703846:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060692736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703873:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060692736:12345-0@lo:400:kworker.0 Request processed in 28us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839629.703879:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788839629.703904:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693248 00000100:00100000:0.0:1788839629.703907:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693248 00000100:00100000:0.0:1788839629.703928:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788839629.703933:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060693248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.703960:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060693248:12345-0@lo:400:kworker.0 Request processed in 27us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839629.703965:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788839629.703987:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839629.703991:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839629.704013:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060692736:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.704432:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060693248:0@lo:400:kworker.0 00010000:00080000:0.0:1788839629.704445:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aec000 x1875734060693760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839629.704464:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060693760:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.704477:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060693120:0@lo:400:kworker.0 00000100:00100000:0.0:1788839629.704488:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060693632:0@lo:400:kworker.0 00010000:00080000:1.0:1788839629.705104:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fa680 x1875734060692224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839629.705124:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060692224:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839629.705619:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692608 00000100:00100000:2.0:1788839629.705627:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692608 00000100:00100000:2.0:1788839629.705838:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839629.705849:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060692608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839629.705873:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839629.705953:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060692608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (3616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.705960:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839629.705989:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060692864:0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706039:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839629.706067:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060693376:0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706090:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839629.706111:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788839629.706117:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060692992:0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706141:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839629.706160:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060693504:0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706194:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839629.706225:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692864 00000100:00100000:2.0:1788839629.706229:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692864 00000100:00100000:2.0:1788839629.706256:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693376 00000100:00100000:2.0:1788839629.706259:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693376 00000100:00080000:0.0:1788839629.706453:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839629.706459:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839629.706534:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693504 00000100:00100000:2.0:1788839629.706538:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693504 00000100:00080000:0.0:1788839629.706563:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839629.706630:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788839629.706636:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060692864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706699:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060692864:12345-0@lo:400:kworker.0 Request processed in 63us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.706706:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788839629.706719:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788839629.706726:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060693376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706755:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060693376:12345-0@lo:400:kworker.0 Request processed in 28us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.706789:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788839629.706803:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788839629.706809:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060693504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706853:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060693504:12345-0@lo:400:kworker.0 Request processed in 44us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.706858:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788839629.706882:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060692992 00000100:00100000:2.0:1788839629.706886:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060692992 00000100:00100000:2.0:1788839629.706910:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839629.706916:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060692992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839629.706946:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060692992:12345-0@lo:400:kworker.0 Request processed in 31us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839629.706952:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788839629.706993:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d48a80 x1875734060692608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839645 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839629.707009:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060692608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839629.708511:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060692992:0@lo:400:kworker.0 00010000:00080000:1.0:1788839629.708531:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9f80 x1875734060693504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839645 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839629.708541:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060693504:0@lo:400:kworker.0 00000100:00100000:1.0:1788839629.708553:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060692864:0@lo:400:kworker.0 00000100:00100000:1.0:1788839629.708564:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060693376:0@lo:400:kworker.0 00000100:00100000:1.0:1788839630.207615:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060693888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839630.207695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839630.207860:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060693888 00000100:00100000:0.0:1788839630.207869:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060693888 00000100:00100000:0.0:1788839630.207934:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788839630.207943:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060693888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839630.207976:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839630.208023:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060693888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839630.208030:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788839630.208112:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060693888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839630.503975:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839630.504016:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839630.504050:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839630.504081:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127744 00000100:00100000:3.0:1788839630.504084:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128000 00000100:00100000:3.0:1788839630.504092:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128000 00000100:00100000:2.0:1788839630.504098:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127744 00000100:00100000:0.0:1788839630.504168:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128256 00000100:00100000:0.0:1788839630.504174:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128256 00000100:00100000:0.0:1788839630.504226:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788839630.504238:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128256:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839630.504313:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128256:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839630.504321:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1788839630.504336:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788839630.504345:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128000:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:0.0:1788839630.504347:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839630.504353:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839630.504373:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128000:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839630.504378:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788839630.504608:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:3.0:1788839630.504616:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050127744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839630.504661:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050127744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 46us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839630.504668:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:3.0:1788839630.504979:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839630.505015:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839630.505039:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839630.505061:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839630.505080:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127872 00000100:00100000:3.0:1788839630.505084:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127872 00000100:00100000:3.0:1788839630.505105:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128128 00000100:00100000:3.0:1788839630.505106:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128128 00000100:00100000:3.0:1788839630.505120:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:3.0:1788839630.505124:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050127872:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839630.505178:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050127872:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839630.505185:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:3.0:1788839630.505204:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:3.0:1788839630.505211:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128128:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839630.505231:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128128:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839630.505235:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:3.0:1788839630.505249:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128384 00000100:00100000:3.0:1788839630.505251:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128384 00000100:00100000:3.0:1788839630.505269:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1788839630.505274:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128384:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839630.505289:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050128384:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 17us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839630.505293:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:3.0:1788839630.505306:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839630.505308:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839630.506018:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050127616 00000100:00100000:2.0:1788839630.506025:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050127616 00000100:00100000:2.0:1788839630.506074:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:2.0:1788839630.506093:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050127616:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839630.506142:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050127616:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 60us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839630.506149:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 311 00010000:00010000:2.0:1788839630.655593:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788839631.130073:0:12474:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839631.130399:0:12474:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839631.679109:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839632.257434:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060694016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839632.257511:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839632.257563:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694016 00000100:00100000:1.0:1788839632.257572:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694016 00000100:00100000:1.0:1788839632.257621:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788839632.257629:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060694016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839632.257660:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839632.257722:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060694016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839632.257729:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788839632.257748:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060694016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839632.703050:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788839633.265185:0:12571:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839633.265435:0:12571:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788839633.727750:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839634.753595:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839634.816179:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060694144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839634.816255:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.817274:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694144 00000100:00100000:0.0:1788839634.817282:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694144 00000100:00100000:0.0:1788839634.817725:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788839634.817737:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060694144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839634.817767:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839634.817863:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060694144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839634.817870:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788839634.817930:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060694400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839634.817965:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839634.818011:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839634.818022:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694400 00000100:00100000:0.0:1788839634.818026:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694400 00000100:00100000:0.0:1788839634.818052:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788839634.818059:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060694400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839634.818074:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839634.818107:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060694400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839634.818113:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788839634.818162:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060694272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839634.818187:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839634.818211:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788839634.818235:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f8e00 x1875734060694400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839634.818254:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060694400:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839634.818274:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694272 00000100:00100000:1.0:1788839634.818646:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060694784:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.818677:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839634.818695:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060695296:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.818718:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839634.818737:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788839634.818743:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060694656:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.818762:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839634.818811:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060695168:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.818831:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839634.818848:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060695680:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.818866:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839634.818892:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694784 00000100:00100000:1.0:1788839634.818895:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694784 00000100:00100000:1.0:1788839634.818927:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788839634.818933:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060694784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.818974:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060694784:12345-0@lo:400:kworker.0 Request processed in 41us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.818991:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788839634.819010:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695296 00000100:00100000:1.0:1788839634.819013:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695296 00000100:00100000:1.0:1788839634.819041:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694656 00000100:00100000:1.0:1788839634.819045:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694656 00000100:00100000:1.0:1788839634.819056:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695168 00000100:00100000:1.0:1788839634.819058:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695168 00000100:00100000:1.0:1788839634.819069:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695680 00000100:00100000:1.0:1788839634.819072:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695680 00000100:00100000:1.0:1788839634.819089:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788839634.819879:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694272 00000100:00100000:0.0:1788839634.819920:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788839634.819929:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060694272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839634.819945:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839634.819986:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060694272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839634.819993:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788839634.820015:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060694528:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.820045:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.820073:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060695040:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.820096:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.820114:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060695552:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.820146:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.820160:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788839634.820167:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060694912:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.820188:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.820199:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060695424:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.820219:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.820247:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694528 00000100:00100000:0.0:1788839634.820251:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694528 00000100:00100000:0.0:1788839634.820279:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788839634.820457:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060695296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820496:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060695296:12345-0@lo:400:kworker.0 Request processed in 1401us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820503:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788839634.820516:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695552 00000100:00100000:1.0:1788839634.820519:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695552 00000100:00100000:1.0:1788839634.820533:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060694912 00000100:00100000:1.0:1788839634.820535:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060694912 00000100:00100000:1.0:1788839634.820548:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788839634.820553:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060694656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820586:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060694656:12345-0@lo:400:kworker.0 Request processed in 33us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820592:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788839634.820607:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788839634.820614:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060695168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820642:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060695168:12345-0@lo:400:kworker.0 Request processed in 29us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820649:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788839634.820670:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788839634.820676:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060695680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820704:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060695680:12345-0@lo:400:kworker.0 Request processed in 30us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820710:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788839634.820720:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788839634.820726:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060695552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820760:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060695552:12345-0@lo:400:kworker.0 Request processed in 34us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820765:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788839634.820791:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788839634.820867:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060694912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820897:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060694912:12345-0@lo:400:kworker.0 Request processed in 100us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820903:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788839634.820932:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695040 00000100:00100000:1.0:1788839634.820936:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695040 00000100:00100000:1.0:1788839634.820953:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788839634.820959:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060695040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.820989:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060695040:12345-0@lo:400:kworker.0 Request processed in 30us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839634.820995:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788839634.821015:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839634.821019:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839634.821021:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839634.821061:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060695808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839634.821102:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839634.821216:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060694528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.821250:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060694528:12345-0@lo:400:kworker.0 Request processed in 965us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839634.821257:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788839634.821462:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695808 00000100:00100000:3.0:1788839634.821467:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695808 00000100:00100000:3.0:1788839634.821501:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839634.821508:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060695808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839634.821522:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839634.821558:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060695808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839634.821566:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788839634.821582:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839634.822251:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695424 00000100:00100000:0.0:1788839634.822265:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695424 00000100:00100000:0.0:1788839634.822317:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839634.822325:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060695424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.822364:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060695424:12345-0@lo:400:kworker.0 Request processed in 42us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839634.822370:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839634.822417:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060694912:0@lo:400:kworker.0 00010000:00080000:0.0:1788839634.822431:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4fb80 x1875734060695424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839634.822440:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060695424:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.822450:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060694528:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.822461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060695040:0@lo:400:kworker.0 00000100:00100000:0.0:1788839634.822472:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060695552:0@lo:400:kworker.0 00010000:00080000:0.0:1788839634.822520:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed880 x1875734060694144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839634.822535:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060694144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839634.822621:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060694656:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.822637:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060695168:0@lo:400:kworker.0 00010000:00080000:1.0:1788839634.822648:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b4df80 x1875734060695680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839634.822657:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060695680:0@lo:400:kworker.0 00000100:00100000:1.0:1788839634.822667:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060694784:0@lo:400:kworker.0 00010000:00080000:1.0:1788839634.822678:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486cb480 x1875734060695296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839634.822685:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060695296:0@lo:400:kworker.0 00010000:00080000:1.0:1788839634.822696:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab641aec000 x1875734060694272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839634.822708:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060694272:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788839634.822736:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777cab100 x1875734060695808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839650 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839634.822744:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060695808:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788839635.000228:0:12669:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839635.000566:0:12669:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788839635.327070:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839635.327095:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060695936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839635.327958:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839635.328482:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060695936 00000100:00100000:1.0:1788839635.328492:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060695936 00000100:00100000:1.0:1788839635.328546:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788839635.328556:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060695936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839635.328591:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839635.329942:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060695936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1382us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839635.329963:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788839635.332866:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060695936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839635.631110:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631163:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631183:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631207:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631232:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631258:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631286:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839635.631323:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128640 00000100:00100000:3.0:1788839635.631332:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128640 00000100:00100000:3.0:1788839635.631387:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128896 00000100:00100000:3.0:1788839635.631391:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128896 00000100:00100000:3.0:1788839635.631404:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128768 00000100:00100000:3.0:1788839635.631406:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128768 00000100:00100000:3.0:1788839635.631417:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129024 00000100:00100000:3.0:1788839635.631419:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129024 00000100:00100000:3.0:1788839635.631432:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:3.0:1788839635.631442:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050128640:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839635.631516:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050128640:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839635.631523:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:3.0:1788839635.631540:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:3.0:1788839635.631547:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050128896:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839635.631596:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050128896:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839635.631602:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:3.0:1788839635.631614:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:3.0:1788839635.631620:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050128768:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839635.631644:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050128768:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839635.631651:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:3.0:1788839635.631663:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:3.0:1788839635.631670:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050129024:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839635.631691:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050129024:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839635.631697:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:3.0:1788839635.631716:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129152 00000100:00100000:3.0:1788839635.631718:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129152 00000100:00100000:3.0:1788839635.631743:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129280 00000100:00100000:3.0:1788839635.631746:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129280 00000100:00100000:3.0:1788839635.631767:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788839635.633138:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2388:x1875734050129152:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1788839635.633168:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572c2c 00000100:00080000:3.0:1788839635.633177:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab647b12000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839635.633231:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788839635.633389:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:369e11fa-e360-4215-b9ed-184f44a2087d+2:2388:x1875734050129152:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 269us (2223us total) trans 0 rc 0/0 00010000:00010000:2.0:1788839635.633422:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839635.636344:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839635.636354:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839635.636357:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839635.636360:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839635.636391:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050128512 00000100:00100000:2.0:1788839635.636404:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050128512 00000100:00100000:2.0:1788839635.636469:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 313 00000100:00100000:2.0:1788839635.636480:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050128512:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839635.636548:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050128512:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (5314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839635.636556:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 313 00000100:00100000:0.0:1788839635.636681:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839635.636701:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2388:x1875734050129280:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1788839635.636743:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572c33 00000100:00080000:0.0:1788839635.636754:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8ab647b13800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839635.636905:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788839635.637027:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:369e11fa-e360-4215-b9ed-184f44a2087d+2:2388:x1875734050129280:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 337us (5818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839635.637035:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:2.0:1788839635.644890:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839635.645049:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:2.0:1788839635.776638:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839636.800423:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788839636.893202:0:12767:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839636.893538:0:12767:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788839637.377316:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839637.377340:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060696064:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839637.377405:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839637.378434:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696064 00000100:00100000:0.0:1788839637.378456:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696064 00000100:00100000:0.0:1788839637.378514:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788839637.378523:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060696064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839637.378558:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839637.378629:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060696064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 106us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839637.378636:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788839637.378801:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060696064:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839637.829604:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788839638.594645:0:12864:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839638.595010:0:12864:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839638.847047:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839639.871139:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839639.935434:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839639.935458:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060696192:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839639.935530:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839639.935591:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696192 00000100:00100000:3.0:1788839639.935599:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696192 00000100:00100000:3.0:1788839639.935651:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839639.935661:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060696192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839639.935688:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839639.935743:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060696192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839639.935763:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788839639.935794:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839639.935804:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060696320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839639.935811:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060696448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839639.935839:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839639.935988:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839639.936142:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b1c00 x1875734060696192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839639.936160:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060696192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839639.936291:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060696576:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839639.936319:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839639.936356:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696448 00000100:00100000:0.0:1788839639.936360:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696448 00000100:00100000:0.0:1788839639.936382:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696320 00000100:00100000:0.0:1788839639.936385:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696320 00000100:00100000:0.0:1788839639.936396:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696576 00000100:00100000:0.0:1788839639.936398:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696576 00000100:00100000:0.0:1788839639.936413:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839639.936421:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060696448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839639.936443:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839639.936472:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060696448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839639.936479:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839639.936493:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788839639.936499:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060696320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839639.936517:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839639.936549:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060696320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839639.936555:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788839639.936566:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788839639.936820:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839639.936824:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839639.936910:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060697088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.936945:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839639.936967:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060697600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.936986:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839639.937109:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697088 00000100:00100000:3.0:1788839639.937114:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697088 00000100:00100000:3.0:1788839639.937144:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697600 00000100:00100000:3.0:1788839639.937148:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697600 00000100:00100000:1.0:1788839639.937156:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060696832:0@lo:400:kworker.0 00000100:00100000:3.0:1788839639.937173:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788839639.937182:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060697088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839639.937219:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060697088:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839639.937226:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788839639.937238:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788839639.937244:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060697600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839639.937280:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060697600:12345-0@lo:400:kworker.0 Request processed in 36us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839639.937286:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00080000:3.0:1788839639.937309:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839639.937324:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839639.937352:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060697344:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.937413:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788839639.937422:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060696960:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.937462:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839639.937482:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788839639.937488:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060696704:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.937513:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839639.937541:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060697216:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.937563:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839639.938134:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.938159:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839639.938225:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9880 x1875734060696448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839639.938243:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060696448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839639.938271:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696832 00000100:00100000:1.0:1788839639.938275:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696832 00000100:00100000:1.0:1788839639.938313:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697344 00000100:00100000:1.0:1788839639.938316:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697344 00000100:00100000:1.0:1788839639.938334:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697728 00000100:00100000:1.0:1788839639.938337:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697728 00000100:00100000:1.0:1788839639.938350:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788839639.938356:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060696832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.938395:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060696832:12345-0@lo:400:kworker.0 Request processed in 38us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839639.938401:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788839639.938413:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788839639.938419:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060697344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.938445:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060697344:12345-0@lo:400:kworker.0 Request processed in 26us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839639.938451:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788839639.938462:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788839639.938467:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060697728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.938493:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060697728:12345-0@lo:400:kworker.0 Request processed in 26us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839639.938498:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:1.0:1788839639.938517:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839639.938520:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788839639.938714:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e679880 x1875734060697728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839639.938725:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060697728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.938736:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060696832:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.938744:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060697344:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939072:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839639.939116:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060697472:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939142:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839639.939167:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060697088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939179:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060697600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939203:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697216 00000100:00100000:2.0:1788839639.939207:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697216 00000100:00100000:2.0:1788839639.939229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696960 00000100:00100000:2.0:1788839639.939232:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696960 00000100:00100000:2.0:1788839639.939243:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788839639.939249:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060697216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939295:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060697216:12345-0@lo:400:kworker.0 Request processed in 41us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839639.939301:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788839639.939314:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788839639.939320:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060696960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939356:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060696960:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839639.939361:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788839639.939376:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697472 00000100:00100000:2.0:1788839639.939387:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697472 00000100:00100000:2.0:1788839639.939416:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788839639.939422:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060697472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839639.939451:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e679f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060697472:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839639.939457:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:2.0:1788839639.939470:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839639.939489:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060696960:0@lo:400:kworker.0 00010000:00080000:2.0:1788839639.939500:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e678e00 x1875734060697472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839655 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839639.939509:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060697472:0@lo:400:kworker.0 00010000:00080000:2.0:1788839639.939537:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9500 x1875734060696320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839639.939550:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060696320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839639.940358:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060696576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839639.940377:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839639.940397:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060696704 00000100:00100000:3.0:1788839639.940403:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060696704 00000100:00100000:0.0:1788839639.940429:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060696576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839639.940438:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788839639.940441:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788839639.940451:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060696704:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788839639.940480:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486cb480 x1875734060696576/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839655 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839639.940497:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060696704:12345-0@lo:400:kworker.0 Request processed in 47us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839639.940497:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060696576:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839639.940510:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788839639.940862:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060696704:0@lo:400:kworker.0 00000100:00100000:1.0:1788839639.940878:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060697216:0@lo:400:kworker.0 00000100:00100000:0.0:1788839640.449681:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839640.449706:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060697856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839640.449795:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839640.449867:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697856 00000100:00100000:0.0:1788839640.449876:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697856 00000100:00100000:0.0:1788839640.449953:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788839640.449970:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060697856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839640.450004:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839640.450049:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060697856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839640.450056:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788839640.450114:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060697856:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839640.750465:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839640.750512:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839640.750542:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839640.750570:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839640.750947:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839640.750984:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129408 00000100:00100000:0.0:1788839640.750994:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129408 00000100:00100000:0.0:1788839640.751046:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:0.0:1788839640.751058:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050129408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839640.751147:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050129408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 92us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839640.751156:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:0.0:1788839640.751194:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129664 00000100:00100000:0.0:1788839640.751197:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129664 00000100:00100000:0.0:1788839640.751242:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129920 00000100:00100000:0.0:1788839640.751246:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129920 00000100:00100000:0.0:1788839640.751265:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129536 00000100:00100000:0.0:1788839640.751267:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129536 00000100:00100000:0.0:1788839640.751286:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050129792 00000100:00100000:0.0:1788839640.751288:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050129792 00000100:00100000:0.0:1788839640.751308:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:0.0:1788839640.751316:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050129664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839640.751350:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050129664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839640.751367:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:0.0:1788839640.751381:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:0.0:1788839640.751388:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050129920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839640.751416:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050129920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839640.751422:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:0.0:1788839640.751433:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788839640.751441:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050129536:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839640.751465:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050129536:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839640.751474:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788839640.751488:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:0.0:1788839640.751493:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050129792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839640.751513:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050129792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 19us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839640.751519:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00080000:0.0:1788839640.752034:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839640.752039:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788839640.895097:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788839640.965653:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000020:00000080:1.0:1788839640.965664:0:9483:0:(genops.c:885:class_export_put()) final put ffff8ab647b15800/369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00100000:2.0:1788839640.966633:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000020:00000080:2.0:1788839640.966639:0:8397:0:(genops.c:885:class_export_put()) final put ffff8ab647b10800/369e11fa-e360-4215-b9ed-184f44a2087d 00000020:00000080:3.0:1788839640.969883:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647b15800/369e11fa-e360-4215-b9ed-184f44a2087d for lustre-OST0001 00000020:00000080:3.0:1788839640.970002:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647b13800 for lustre-OST0001 00000020:00000080:3.0:1788839640.970262:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647b10800/369e11fa-e360-4215-b9ed-184f44a2087d for lustre-OST0000 00000020:00000080:3.0:1788839640.970297:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647b12000 for lustre-OST0000 00010000:00010000:3.0:1788839641.923552:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839642.078001:0:13008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788839642.495549:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060697984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839642.495632:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839642.495890:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060697984 00000100:00100000:3.0:1788839642.495899:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060697984 00000100:00100000:3.0:1788839642.495997:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788839642.496007:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060697984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839642.496044:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839642.496111:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060697984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839642.496118:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788839642.496193:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060697984:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839642.945405:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839643.967234:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839644.993506:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839645.055195:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839645.055228:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060698112:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839645.055296:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.055357:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698112 00000100:00100000:3.0:1788839645.055376:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698112 00000100:00100000:3.0:1788839645.055431:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839645.055441:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060698112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839645.055477:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839645.055520:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060698112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.055527:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788839645.055546:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788839645.055691:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed180 x1875734060698112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839645.055709:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060698112:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839645.056239:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060698240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839645.056280:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839645.056316:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839645.056322:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060698368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839645.056346:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839645.056760:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839645.056785:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060698496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839645.056817:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839645.056848:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698240 00000100:00100000:2.0:1788839645.056854:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698240 00000100:00100000:2.0:1788839645.056891:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698368 00000100:00100000:2.0:1788839645.056894:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698368 00000100:00100000:2.0:1788839645.056908:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698496 00000100:00100000:2.0:1788839645.056910:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698496 00000100:00100000:2.0:1788839645.056927:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788839645.056935:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060698240:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839645.057566:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839645.057579:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060698368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839645.057600:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839645.057645:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060698368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.057653:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839645.057669:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788839645.057675:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060698496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839645.057685:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839645.057714:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060698496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.057726:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788839645.057755:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e678e00 x1875734060698496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839645.057832:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060698496:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788839645.058480:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819b0e00 x1875734060698368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839645.058496:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060698368:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839645.058649:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839645.058710:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060698240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1775us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.058717:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788839645.058741:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839645.058746:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839645.058886:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060699008:0@lo:400:kworker.0 00000100:00100000:2.0:1788839645.058923:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839645.058956:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060699520:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059101:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060698880:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059131:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839645.059150:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060699392:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059170:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839645.059185:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060699904:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059212:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839645.059231:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788839645.059236:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060698752:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059258:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839645.059288:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060699264:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059311:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839645.059329:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060699776:0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059348:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.059424:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.059455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.059605:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060699136:0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.059634:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.059653:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060699648:0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.059679:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.059695:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060700160:0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.059716:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.059756:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698624 00000100:00100000:3.0:1788839645.059763:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698624 00000100:00100000:3.0:1788839645.059825:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788839645.059833:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699008 00000100:00100000:3.0:1788839645.059834:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060698624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839645.059840:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699008 00000100:00100000:1.0:1788839645.059870:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699392 00000100:00100000:1.0:1788839645.059874:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699392 00000100:00100000:3.0:1788839645.059884:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060698624:12345-0@lo:400:kworker.0 Request processed in 51us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.059891:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788839645.059901:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699904 00000100:00100000:1.0:1788839645.059905:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699904 00000100:00100000:1.0:1788839645.059918:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698752 00000100:00100000:1.0:1788839645.059921:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698752 00000100:00100000:1.0:1788839645.059933:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699264 00000100:00100000:1.0:1788839645.059936:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699264 00000100:00100000:1.0:1788839645.059947:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699776 00000100:00100000:1.0:1788839645.059949:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699776 00000100:00100000:1.0:1788839645.059962:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788839645.059967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060699008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839645.060233:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839645.060256:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060700032:0@lo:400:kworker.0 00000100:00100000:2.0:1788839645.060280:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839645.060311:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699648 00000100:00100000:2.0:1788839645.060314:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699648 00000100:00100000:2.0:1788839645.060336:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060700160 00000100:00100000:2.0:1788839645.060339:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060700160 00000100:00100000:2.0:1788839645.060349:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699520 00000100:00100000:2.0:1788839645.060351:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699520 00000100:00100000:2.0:1788839645.060360:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060700032 00000100:00100000:2.0:1788839645.060362:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060700032 00000100:00100000:2.0:1788839645.060373:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839645.060379:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060699648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839645.060413:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060699648:12345-0@lo:400:kworker.0 Request processed in 34us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.060419:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839645.060433:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839645.060439:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060700160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.060649:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060698880 00000100:00100000:3.0:1788839645.060654:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060698880 00000100:00100000:3.0:1788839645.060674:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060699136 00000100:00100000:3.0:1788839645.060676:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060699136 00000100:00100000:3.0:1788839645.060688:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788839645.060694:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060698880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.060742:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060698880:12345-0@lo:400:kworker.0 Request processed in 47us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.060748:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788839645.060760:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788839645.060766:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060699136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.060815:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788839645.060820:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060699136:12345-0@lo:400:kworker.0 Request processed in 52us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.060831:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788839645.060833:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060699392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.060856:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788839645.060865:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060699520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.060885:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060699392:12345-0@lo:400:kworker.0 Request processed in 59us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.060894:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788839645.061537:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060699520:12345-0@lo:400:kworker.0 Request processed in 47us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.061544:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788839645.061549:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839645.061560:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060699904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.061571:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788839645.061580:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060700032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061601:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060699904:12345-0@lo:400:kworker.0 Request processed in 46us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.061610:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788839645.061624:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060700032:12345-0@lo:400:kworker.0 Request processed in 45us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.061632:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788839645.061635:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788839645.061644:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060698752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061684:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060698752:12345-0@lo:400:kworker.0 Request processed in 43us (2425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.061694:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060698880:0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061694:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00010000:00080000:3.0:1788839645.061716:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c77480 x1875734060699392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839645.061717:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788839645.061729:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060699264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.061732:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060699392:0@lo:400:kworker.0 00010000:00080000:3.0:1788839645.061747:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c74a80 x1875734060699904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839645.061767:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060699264:12345-0@lo:400:kworker.0 Request processed in 38us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.061794:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060699904:0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061806:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788839645.061825:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788839645.061836:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060698752:0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061837:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060699776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.061852:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060699264:0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061881:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060699776:12345-0@lo:400:kworker.0 Request processed in 48us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.061887:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060699776:0@lo:400:kworker.0 00000100:00100000:0.0:1788839645.061892:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00010000:00080000:0.0:1788839645.061941:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed180 x1875734060698240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839645.061983:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060698240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839645.062637:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060699008:12345-0@lo:400:kworker.0 Request processed in 1022us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839645.062647:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788839645.062862:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e678a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060698624:0@lo:400:kworker.0 00000100:00100000:3.0:1788839645.062875:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e679880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060699136:0@lo:400:kworker.0 00010000:00080000:3.0:1788839645.062885:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c76a00 x1875734060699648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839645.062893:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060699648:0@lo:400:kworker.0 00010000:00080000:3.0:1788839645.062902:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b2680 x1875734060700160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839645.062918:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060700160:0@lo:400:kworker.0 00000100:00080000:1.0:1788839645.063825:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839645.063832:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839645.066250:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060700160:12345-0@lo:400:kworker.0 Request processed in 612us (1333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.066264:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839645.066729:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060699008:0@lo:400:kworker.0 00010000:00080000:2.0:1788839645.066747:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c76d80 x1875734060699520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839645.066757:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060699520:0@lo:400:kworker.0 00010000:00080000:2.0:1788839645.066786:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476b0380 x1875734060700032/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839645.066795:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060700032:0@lo:400:kworker.0 00000020:00000080:3.0:1788839645.370924:0:13156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5aeea850 20000000:00000080:3.0:1788839645.370943:0:13156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab64781c800 uarg=0000000000000000 20000000:01000000:3.0:1788839645.370987:0:13156:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788839645.370992:0:13156:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788839645.370996:0:13156:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788839645.372152:0:13157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788839645.372397:0:13156:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788839645.379958:0:13156:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788839645.379994:0:13156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380015:0:13156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380127:0:13156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380134:0:13156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bdf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380140:0:13156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380146:0:13156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572bfb expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380153:0:13156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380161:0:13156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380212:0:13156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380230:0:13156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.380246:0:13156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700288:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839645.380548:0:13156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572bfb expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380558:0:13156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572bfb expref: 23 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.380575:0:13156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700416:0@lo:104: 00000100:00100000:1.0:1788839645.380617:0:13156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839645.380651:0:13156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380660:0:13156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.380669:0:13156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700544:0@lo:104: 00000100:00100000:1.0:1788839645.380695:0:13156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839645.380716:0:13156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572bdf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.380725:0:13156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572bdf expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.380733:0:13156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700672:0@lo:104: 00000100:00100000:2.0:1788839645.380747:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060700416 00000100:00100000:2.0:1788839645.380756:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060700416 00000100:00100000:1.0:1788839645.380757:0:13156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839645.380824:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060700544 00000100:00100000:2.0:1788839645.380828:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060700544 00000100:00100000:2.0:1788839645.380839:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060700672 00000100:00100000:2.0:1788839645.380841:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060700672 00000100:00100000:2.0:1788839645.380855:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839645.380863:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:13156:x1875734060700416:12345-0@lo:104: 00010000:00010000:2.0:1788839645.380878:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839645.380933:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839645.380939:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+5:13156:x1875734060700416:12345-0@lo:104: Request processed in 78us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.380946:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839645.380963:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839645.380976:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:13156:x1875734060700544:12345-0@lo:104: 00010000:00010000:2.0:1788839645.380995:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839645.381031:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788839645.381036:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+4:13156:x1875734060700544:12345-0@lo:104: Request processed in 61us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.381042:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839645.381069:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839645.381076:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:13156:x1875734060700672:12345-0@lo:104: 00010000:00010000:2.0:1788839645.381084:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839645.381113:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788839645.381118:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:13156:x1875734060700672:12345-0@lo:104: Request processed in 44us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.381124:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788839645.381148:0:13156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.381159:0:13156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 23 pid: 6481 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.381169:0:13156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700800:0@lo:104: 00000100:00100000:1.0:1788839645.381198:0:13156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839645.381253:0:13156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.381384:0:13156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.381403:0:13156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700928:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839645.381440:0:13156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839645.381466:0:13156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700416:0@lo:104: 00000100:00100000:1.0:1788839645.381480:0:13156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700544:0@lo:104: 00000100:00100000:1.0:1788839645.381494:0:13156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700672:0@lo:104: 00010000:00010000:1.0:1788839645.381678:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788839645.381686:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.381695:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839645.381699:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.381708:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839645.381716:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839645.381723:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839645.381756:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.381763:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788839645.384271:0:6470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060700800 00000100:00100000:3.0:1788839645.384347:0:6470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060700800 00000100:00100000:3.0:1788839645.384404:0:6470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839645.384414:0:6470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:13156:x1875734060700800:12345-0@lo:104: 00010000:00010000:3.0:1788839645.384445:0:6470:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.384534:0:6470:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788839645.384540:0:6470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:096dcd45-3d06-4359-b81b-4bde04036a06+3:13156:x1875734060700800:12345-0@lo:104: Request processed in 129us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.384548:0:6470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788839645.384791:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060701056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839645.384833:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.385070:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701056 00000100:00100000:3.0:1788839645.385075:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701056 00010000:00010000:3.0:1788839645.385098:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bfb expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839645.385126:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839645.385133:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060701056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839645.385144:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839645.385149:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bfb expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.385160:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572bfb expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.385177:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553800/0xad5b343a26572c02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572bfb expref: 24 pid: 6480 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.385191:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839645.385249:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385255:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031c00/0xad5b343a26572bfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c02 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385265:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788839645.385268:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385272:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839645.385282:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385288:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839645.385293:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839645.385297:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839645.385320:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385324:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788839645.385497:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:096dcd45-3d06-4359-b81b-4bde04036a06+23:3614:x1875734060701056:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.385503:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839645.385525:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060701184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839645.385564:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839645.385619:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385626:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26572bed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572bf4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385636:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788839645.385646:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385652:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839645.385655:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385662:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839645.385668:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839645.385674:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839645.385702:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385708:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839645.385729:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385735:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26572bdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572be6 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385745:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839645.385748:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.385752:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839645.385755:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839645.385827:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060701056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839645.385910:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701184 00000100:00100000:0.0:1788839645.385915:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701184 00010000:00010000:0.0:1788839645.385934:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839645.385957:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788839645.385963:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+23:3615:x1875734060701184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839645.385971:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839645.385975:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.385982:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.385992:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031600/0xad5b343a26572bf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572bed expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.386002:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839645.386031:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+22:3615:x1875734060701184:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.386037:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788839645.386074:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060701184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839645.386118:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839645.386125:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839645.386130:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839645.386147:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.386153:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839645.386160:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.386167:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647842e00/0xad5b343a26572bd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572bd8 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839645.386179:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839645.386180:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839645.386181:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839645.386187:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839645.386211:0:13156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700800:0@lo:104: 00000100:00100000:3.0:1788839645.386341:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060701440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839645.386372:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.386400:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839645.386406:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060701312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839645.386425:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839645.386453:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701440 00000100:00100000:3.0:1788839645.386457:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701440 00010000:00010000:3.0:1788839645.386472:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 22 pid: 6481 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839645.386489:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701312 00000100:00100000:3.0:1788839645.386492:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701312 00010000:00010000:3.0:1788839645.386503:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bdf expref: 23 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839645.386517:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788839645.386522:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:096dcd45-3d06-4359-b81b-4bde04036a06+23:3617:x1875734060701440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839645.386530:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839645.386534:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 23 pid: 6481 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.386541:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 23 pid: 6481 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.386551:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572bd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572bd1 expref: 23 pid: 6481 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.386560:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839645.386592:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:096dcd45-3d06-4359-b81b-4bde04036a06+22:3617:x1875734060701440:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.386599:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788839645.386612:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839645.386618:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060701312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839645.386625:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839645.386630:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572bdf expref: 21 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.386637:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572bdf expref: 21 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.386647:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553600/0xad5b343a26572be6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572bdf expref: 21 pid: 6479 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.386655:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839645.386676:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:096dcd45-3d06-4359-b81b-4bde04036a06+20:3617:x1875734060701312:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.386682:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839645.386708:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060701312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839645.386715:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060701440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839645.388624:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839645.388691:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130048 00000100:00100000:3.0:1788839645.388700:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130048 00010000:00010000:3.0:1788839645.388738:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 13 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839645.388801:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788839645.388811:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050130048:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839645.388840:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839645.388847:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 13 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.388861:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 13 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.388880:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839645.388928:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050130048:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 119us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839645.388935:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00010000:00010000:1.0:1788839645.389196:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7477c expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839645.389213:0:13156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700288:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839645.389224:0:13156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13156:1875734060700928:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839645.389405:0:13156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839645.391702:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839645.391759:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130176 00000100:00100000:0.0:1788839645.391851:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130176 00010000:00010000:0.0:1788839645.391893:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839645.391969:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788839645.391979:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a94babf6-f8ea-4a10-a503-aad078d53639+12:2389:x1875734050130176:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839645.391997:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839645.392003:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392015:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392034:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553e00/0xad5b343a26572bca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7473d expref: 12 pid: 6479 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392053:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392074:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392093:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392110:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392136:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392142:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392147:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839645.392152:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392159:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392181:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839645.392191:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839645.392229:0:13156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.392240:0:13156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839645.392247:0:13156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab741464400/0xad5b343a26572c3a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839645.392255:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050130176:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 275us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.392265:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788839645.573251:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060701568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839645.573325:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839645.573420:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701568 00000100:00100000:0.0:1788839645.573429:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701568 00000100:00100000:0.0:1788839645.573482:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788839645.573492:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060701568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839645.573528:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839645.580955:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060701568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7454us (7618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.580969:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788839645.584751:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060701568:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839645.866923:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839645.867039:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839645.867146:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130432 00000100:00100000:1.0:1788839645.867157:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130432 00000100:00100000:1.0:1788839645.867237:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:1.0:1788839645.867249:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050130432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839645.867326:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050130432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839645.867334:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00080000:0.0:1788839645.868304:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839645.868957:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839645.868992:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839645.869019:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839645.869087:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130688 00000100:00100000:0.0:1788839645.869095:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130688 00000100:00100000:0.0:1788839645.869142:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130560 00000100:00100000:0.0:1788839645.869144:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130560 00000100:00100000:0.0:1788839645.869161:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130816 00000100:00100000:0.0:1788839645.869163:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130816 00000100:00100000:0.0:1788839645.869179:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1788839645.869188:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050130688:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839645.869292:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130304 00000100:00100000:2.0:1788839645.869296:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130304 00000100:00100000:2.0:1788839645.869327:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 317 00000100:00100000:2.0:1788839645.869334:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050130304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839645.880982:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050130688:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 11784us (12017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.881000:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1788839645.881062:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:0.0:1788839645.881082:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050130560:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839645.886854:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050130304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 17506us (19927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.886872:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 317 00000100:00100000:2.0:1788839645.888382:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:2.0:1788839645.888405:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050130816:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839645.888754:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050130816:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 357us (19731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839645.888763:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00080000:2.0:1788839645.891491:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839645.891501:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839645.893175:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050130560:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 12091us (24168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839645.893201:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00010000:00010000:1.0:1788839646.018980:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839646.593794:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839646.593804:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab646536000 from 7 10000000:01000000:0.0:1788839646.593811:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839646.593867:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.593879:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.593891:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839646.593934:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060701696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.594012:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839646.594074:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839646.594571:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701696 00000100:00100000:3.0:1788839646.594587:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701696 00000100:00100000:3.0:1788839646.594650:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788839646.594659:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060701696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839646.594676:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839646.594694:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572c41 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.594722:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572c41 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.594735:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c41 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.594744:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6c00, rc 0) 00000100:00100000:3.0:1788839646.594874:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060701696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 216us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839646.594881:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788839646.595107:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060701696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839646.595124:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.595135:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839646.595203:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060701824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.595233:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839646.595266:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839646.596885:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701824 00000100:00100000:3.0:1788839646.596897:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701824 00000100:00100000:3.0:1788839646.596941:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788839646.596949:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060701824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.597534:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060701824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 583us (2297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839646.597544:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788839646.601723:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060701824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839646.601822:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060701952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839646.601896:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839646.601941:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839646.602594:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060701952 00000100:00100000:0.0:1788839646.602603:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060701952 00000100:00100000:0.0:1788839646.602669:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788839646.602680:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060701952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.602830:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060701952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839646.602838:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1788839646.602864:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060701952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788839646.606614:0:13177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788839646.606869:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788839646.606893:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839646.606905:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.606916:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839646.606944:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839646.606947:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab777b41000 from 7 10000000:01000000:0.0:1788839646.606949:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839646.606986:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.606994:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.607005:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839646.607028:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.607104:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839646.607149:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839646.607276:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702080 00000100:00100000:2.0:1788839646.607284:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702080 00000100:00100000:2.0:1788839646.611129:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788839646.611150:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060702080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839646.611169:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839646.611189:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572c4f expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839646.611218:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572c4f expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839646.611232:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c4f expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839646.611242:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842000, rc 0) 00000100:00100000:2.0:1788839646.611338:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060702080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (4234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839646.611346:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788839646.613673:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839646.613704:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.613718:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839646.614026:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.614102:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839646.614154:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839646.614220:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702208 00000100:00100000:3.0:1788839646.614227:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702208 00000100:00100000:3.0:1788839646.614275:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788839646.614285:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060702208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.614423:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060702208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839646.614430:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788839646.615041:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.615092:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.615145:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839646.615176:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839646.615191:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702336 00000100:00100000:0.0:1788839646.615195:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702336 00000100:00100000:0.0:1788839646.615233:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788839646.615241:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060702336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.615330:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060702336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839646.615338:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788839646.615372:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788839646.625233:0:13179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788839646.625417:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788839646.625450:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839646.625462:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.625475:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839646.625485:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839646.625488:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab74434b000 from 7 10000000:01000000:0.0:1788839646.625491:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839646.625530:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.625539:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.625550:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839646.625595:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.625665:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839646.625712:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788839646.625916:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702464 00000100:00100000:2.0:1788839646.625923:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702464 00000100:00100000:2.0:1788839646.625972:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788839646.625988:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060702464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839646.626002:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839646.626014:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572c5d expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839646.626038:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572c5d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839646.626058:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c5d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839646.626067:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843200, rc 0) 00000100:00100000:2.0:1788839646.626518:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060702464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 529us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839646.626525:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788839646.627194:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839646.627214:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.627225:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839646.631826:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.631902:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839646.631941:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839646.632000:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702592 00000100:00100000:0.0:1788839646.632010:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702592 00000100:00100000:0.0:1788839646.632070:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788839646.632078:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060702592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839646.632206:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060702592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839646.632213:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788839646.632334:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839646.632369:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839646.632419:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839646.632451:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7506a7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839646.632541:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702720 00000100:00100000:3.0:1788839646.632545:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702720 00000100:00100000:3.0:1788839646.632587:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788839646.632594:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060702720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.632677:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060702720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839646.632683:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788839646.632993:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839646.640069:0:13180:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788839646.640273:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788839646.640298:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839646.640310:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.640323:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839646.640342:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839646.640344:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab745341000 from 7 10000000:01000000:3.0:1788839646.640347:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839646.640384:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.640392:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839646.640403:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839646.640429:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.641003:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839646.641552:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839646.644568:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702848 00000100:00100000:0.0:1788839646.644582:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702848 00000100:00100000:0.0:1788839646.644695:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788839646.644706:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060702848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839646.644725:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839646.644743:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572c6b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.644795:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572c6b expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.644808:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c6b expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839646.644817:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078000, rc 0) 00000100:00100000:0.0:1788839646.644917:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060702848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (3914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839646.644931:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788839646.645030:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c75f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839646.645058:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839646.645079:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839646.645164:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839646.645199:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839646.646833:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7506a7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839646.650803:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060702976 00000100:00100000:3.0:1788839646.650817:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060702976 00000100:00100000:3.0:1788839646.650878:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788839646.650888:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060702976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.651060:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060702976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (5849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839646.651068:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788839646.653383:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060702976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.654681:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060703104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839646.654763:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839646.654983:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839646.657331:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703104 00000100:00100000:2.0:1788839646.657343:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703104 00000100:00100000:2.0:1788839646.657435:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788839646.657458:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060703104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839646.657628:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060703104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839646.657636:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788839646.657792:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060703104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839646.659713:0:13183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788839646.659793:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788839646.659818:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839646.659967:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839646.659980:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839647.039229:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839647.210110:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839647.210247:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050130944 00000100:00100000:2.0:1788839647.210257:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050130944 00000100:00100000:2.0:1788839647.210329:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 330 00000100:00100000:2.0:1788839647.210339:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:6165:x1875734050130944:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839647.210357:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839647.210386:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747ad expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839647.210420:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839647.210431:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839647.210439:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843a00, rc 0) 00000100:00100000:2.0:1788839647.210505:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050130944:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 168us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839647.210512:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 330 00000100:00100000:1.0:1788839647.217397:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839647.219325:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131072 00000100:00100000:2.0:1788839647.219342:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131072 00000100:00100000:2.0:1788839647.219415:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 331 00000100:00100000:2.0:1788839647.219426:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050131072:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839647.219600:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050131072:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 174us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839647.219608:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 331 00000100:00100000:1.0:1788839647.226156:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839647.226272:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131200 00000100:00100000:0.0:1788839647.226282:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131200 00000100:00100000:0.0:1788839647.226341:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 332 00000100:00100000:0.0:1788839647.226352:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050131200:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839647.226500:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050131200:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 150us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839647.226508:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 332 00000100:00100000:1.0:1788839647.250670:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839647.250815:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131328 00000100:00100000:0.0:1788839647.250825:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131328 00000100:00100000:0.0:1788839647.250890:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 333 00000100:00100000:0.0:1788839647.250908:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050131328:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839647.250924:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839647.250943:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747b4 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839647.250972:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839647.250984:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839647.250994:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078a00, rc 0) 00000100:00100000:0.0:1788839647.251057:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050131328:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 152us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839647.251064:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 333 00000100:00100000:1.0:1788839647.255498:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839647.255585:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131456 00000100:00100000:3.0:1788839647.255595:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131456 00000100:00100000:3.0:1788839647.255656:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 334 00000100:00100000:3.0:1788839647.255667:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050131456:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839647.255853:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050131456:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 188us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839647.255861:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 334 00000100:00100000:1.0:1788839647.268580:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839647.268689:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131584 00000100:00100000:0.0:1788839647.268700:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131584 00000100:00100000:0.0:1788839647.268793:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 335 00000100:00100000:0.0:1788839647.268803:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050131584:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839647.269003:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050131584:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 202us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839647.269011:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 335 00000100:00100000:2.0:1788839647.625944:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839647.625971:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060703232:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839647.626060:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839647.626290:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703232 00000100:00100000:1.0:1788839647.626298:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703232 00000100:00100000:1.0:1788839647.626358:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788839647.626368:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060703232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839647.626408:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839647.626467:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060703232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839647.626475:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788839647.626673:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060703232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788839648.067015:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839649.088428:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839649.655401:0:13354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788839650.112549:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839650.175186:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060703360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839650.175261:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.175918:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703360 00000100:00100000:3.0:1788839650.175925:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703360 00000100:00100000:3.0:1788839650.175980:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788839650.175991:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060703360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839650.176038:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839650.176090:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060703360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.176097:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788839650.176123:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060703616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839650.176152:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.176194:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703616 00000100:00100000:3.0:1788839650.176198:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703616 00000100:00100000:3.0:1788839650.176222:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839650.176228:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060703616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839650.176246:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839650.176276:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060703616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.176283:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:3.0:1788839650.176325:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c74a80 x1875734060703616/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839650.176360:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060703616:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788839650.176423:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c77480 x1875734060703360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839650.176436:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060703360:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839650.176446:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839650.176452:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060703488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839650.176474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.176495:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703488 00000100:00100000:3.0:1788839650.176498:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703488 00000100:00100000:3.0:1788839650.176519:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788839650.176525:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060703488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839650.176534:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839650.176562:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060703488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.176568:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788839650.176602:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eed180 x1875734060703488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839650.176614:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060703488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788839650.180762:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839650.180792:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839650.180830:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6476e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839650.180904:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839650.180981:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703744 00000100:00100000:2.0:1788839650.180988:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703744 00000100:00100000:0.0:1788839650.181535:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060704256:0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.181872:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060704000:0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.181991:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060704128:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.182545:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060703872:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.182600:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.182636:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060704384:0@lo:400:kworker.0 00000100:00100000:2.0:1788839650.182845:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788839650.182856:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060703744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839650.182879:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839650.182923:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060703744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839650.182930:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:2.0:1788839650.182951:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839650.182994:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060703872 00000100:00100000:0.0:1788839650.183266:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839650.183480:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839650.183504:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060704640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.183525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839650.183563:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704128 00000100:00100000:1.0:1788839650.183570:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704128 00000100:00100000:1.0:1788839650.183603:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839650.183610:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060704128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.183651:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060704128:12345-0@lo:400:kworker.0 Request processed in 41us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839650.183658:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788839650.183677:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704256 00000100:00100000:1.0:1788839650.183680:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704256 00000100:00100000:0.0:1788839650.183883:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060704768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839650.183912:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788839650.183949:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6476e5c00 x1875734060703744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839650.183970:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6476e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060703744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839650.184514:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060703872 00000100:00100000:2.0:1788839650.184559:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788839650.184566:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060703872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839650.184616:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060703872:12345-0@lo:400:kworker.0 Request processed in 46us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839650.184623:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788839650.184671:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704640 00000100:00100000:2.0:1788839650.184675:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704640 00000100:00100000:3.0:1788839650.185486:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.185528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060704896:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.185586:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.185625:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060703872:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.185658:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704384 00000100:00100000:3.0:1788839650.185662:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704384 00000100:00100000:3.0:1788839650.185701:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788839650.185710:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060704384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.185753:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060704384:12345-0@lo:400:kworker.0 Request processed in 44us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.185759:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788839650.185802:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060704384:0@lo:400:kworker.0 00000100:00080000:3.0:1788839650.185839:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839650.185860:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704768 00000100:00100000:3.0:1788839650.185864:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704768 00000100:00100000:0.0:1788839650.185920:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704896 00000100:00100000:0.0:1788839650.185924:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704896 00000100:00100000:1.0:1788839650.185988:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788839650.185997:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060704256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.186053:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060704256:12345-0@lo:400:kworker.0 Request processed in 58us (4482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839650.186059:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788839650.186274:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788839650.186281:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060704768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.186313:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060704768:12345-0@lo:400:kworker.0 Request processed in 34us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.186319:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1788839650.186334:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839650.186336:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839650.186445:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.186469:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060704512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.186494:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839650.186517:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704000 00000100:00100000:3.0:1788839650.186521:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704000 00000100:00100000:3.0:1788839650.186534:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060704512 00000100:00100000:3.0:1788839650.186536:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060704512 00000100:00100000:3.0:1788839650.186563:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788839650.186567:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060704000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.186612:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060704000:12345-0@lo:400:kworker.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.186618:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788839650.186629:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788839650.186634:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060704512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.186658:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060704512:12345-0@lo:400:kworker.0 Request processed in 24us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.186663:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788839650.186687:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060704000:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.186696:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060704512:0@lo:400:kworker.0 00000100:00080000:3.0:1788839650.186710:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839650.186732:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060704256:0@lo:400:kworker.0 00000100:00100000:3.0:1788839650.186742:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060704768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839650.189627:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788839650.189653:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060704896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839650.189921:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060704896:12345-0@lo:400:kworker.0 Request processed in 282us (4333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839650.189929:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:3.0:1788839650.190100:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af6d80 x1875734060704896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839650.190115:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060704896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.190171:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788839650.190293:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060704128:0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.191227:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060704640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.191303:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060704640:12345-0@lo:400:kworker.0 Request processed in 75us (7765us total) trans 0 rc 0/0 00010000:00080000:0.0:1788839650.192807:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b58a80 x1875734060704640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839650.192824:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060704640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839650.195372:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788839650.687156:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839650.687182:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060705024:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839650.687277:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839650.687693:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705024 00000100:00100000:2.0:1788839650.687702:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705024 00000100:00100000:2.0:1788839650.687761:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788839650.687792:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060705024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839650.687828:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788839650.687885:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060705024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839650.687892:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788839650.687981:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060705024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839650.992893:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839650.992938:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839650.992962:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131840 00000100:00100000:3.0:1788839650.992967:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839650.992972:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131840 00000100:00100000:3.0:1788839650.992985:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839650.993006:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839650.993039:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050132096 00000100:00100000:1.0:1788839650.993055:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131968 00000100:00100000:3.0:1788839650.993058:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050132096 00000100:00100000:1.0:1788839650.993058:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131968 00000100:00100000:1.0:1788839650.993072:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050132224 00000100:00100000:1.0:1788839650.993074:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050132224 00000100:00100000:3.0:1788839650.993080:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1788839650.993089:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:3.0:1788839650.993090:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050131840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839650.993094:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050131968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839650.993174:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050131968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839650.993182:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:1.0:1788839650.993199:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1788839650.993205:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050132096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:2.0:1788839650.993220:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839650.993225:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839650.993240:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050131712 00000100:00100000:2.0:1788839650.993244:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050131712 00000100:00100000:2.0:1788839650.993273:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 337 00000100:00100000:2.0:1788839650.993280:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050131712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839650.995830:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050131840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 2727us (2934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.995846:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:3.0:1788839650.995888:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:3.0:1788839650.995902:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050132224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839650.995956:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050132224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 59us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839650.995962:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:1.0:1788839650.996138:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050132096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 2931us (3197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839650.996146:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:2.0:1788839650.998603:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050131712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 5047us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839650.998621:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 337 00010000:00010000:1.0:1788839651.135988:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839652.162649:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839652.742301:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060705152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839652.742416:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839652.749658:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705152 00000100:00100000:0.0:1788839652.749674:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705152 00000100:00100000:0.0:1788839652.749741:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788839652.749752:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060705152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839652.749812:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839652.749911:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060705152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (7495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839652.749917:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788839652.749977:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060705152:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839653.184147:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839654.211189:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839655.112749:0:13503:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:54:12 (1788839652) === 00010000:00010000:1.0:1788839655.235521:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839655.298883:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060705280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839655.298973:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839655.299053:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839655.299061:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060705408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839655.299087:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839655.299117:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705280 00000100:00100000:3.0:1788839655.299125:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705280 00000100:00100000:3.0:1788839655.299183:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705408 00000100:00100000:3.0:1788839655.299186:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705408 00000100:00100000:3.0:1788839655.299200:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788839655.299208:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060705280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839655.299234:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839655.299270:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060705280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839655.299276:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788839655.299299:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788839655.299305:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060705408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839655.299320:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839655.299350:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e678a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060705408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839655.299356:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788839655.299385:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839655.299388:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788839655.299875:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5a680 x1875734060705280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839655.299896:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060705280:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788839655.299935:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab77e67a680 x1875734060705408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839655.299946:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab77e67a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060705408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839655.299961:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839655.299987:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839655.300308:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705536 00000100:00100000:0.0:1788839655.300315:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705536 00000100:00100000:1.0:1788839655.300334:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839655.300345:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060705664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839655.300367:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788839655.300376:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060705536:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788839655.300474:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839655.300512:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1788839655.300653:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839655.300697:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060705536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 323us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.300704:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788839655.300716:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705664 00000100:00100000:0.0:1788839655.300719:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705664 00000100:00080000:3.0:1788839655.300736:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839655.300749:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788839655.300754:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060705664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839655.300765:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839655.301116:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060705920:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.301494:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060705792:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.301541:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839655.301580:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060706304:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.301605:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839655.301627:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060706816:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.301736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839655.301758:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060706432:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.301803:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839655.301871:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788839655.301878:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060706048:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.301900:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839655.301917:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060706560:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.301937:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839655.301964:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705920 00000100:00100000:1.0:1788839655.301969:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705920 00000100:00100000:0.0:1788839655.302117:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060705664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1360us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.302126:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788839655.302156:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706304 00000100:00100000:0.0:1788839655.302159:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706304 00000100:00100000:0.0:1788839655.302176:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706048 00000100:00100000:0.0:1788839655.302178:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706048 00000100:00100000:0.0:1788839655.302189:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788839655.302194:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060706304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839655.302291:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060706304:12345-0@lo:400:kworker.0 Request processed in 34us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.302298:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788839655.302310:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788839655.302316:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060706048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839655.302348:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060706048:12345-0@lo:400:kworker.0 Request processed in 31us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839655.302351:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839655.302355:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788839655.302637:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706432 00000100:00100000:1.0:1788839655.302642:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706432 00010000:00080000:0.0:1788839655.302648:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af4a80 x1875734060705536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839655.302668:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060705536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839655.302871:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706560 00000100:00100000:1.0:1788839655.302875:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706560 00000100:00100000:1.0:1788839655.302888:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706816 00000100:00100000:1.0:1788839655.302890:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706816 00000100:00100000:1.0:1788839655.302904:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788839655.302910:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060705920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.302945:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060705920:12345-0@lo:400:kworker.0 Request processed in 36us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.302960:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788839655.302975:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788839655.302981:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060706432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303025:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060706432:12345-0@lo:400:kworker.0 Request processed in 45us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.303030:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788839655.303042:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788839655.303047:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060706560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303068:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060706560:12345-0@lo:400:kworker.0 Request processed in 22us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.303074:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788839655.303084:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788839655.303089:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060706816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303109:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060706816:12345-0@lo:400:kworker.0 Request processed in 20us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.303113:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1788839655.303151:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839655.303155:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839655.303167:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060706176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303190:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839655.303205:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060706688:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303220:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839655.303241:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706176 00000100:00100000:1.0:1788839655.303244:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706176 00000100:00100000:1.0:1788839655.303259:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706688 00000100:00100000:1.0:1788839655.303266:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706688 00000100:00100000:1.0:1788839655.303283:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788839655.303288:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060706176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303321:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060706176:12345-0@lo:400:kworker.0 Request processed in 33us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.303328:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788839655.303341:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00010000:00080000:3.0:1788839655.303385:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab646b5df80 x1875734060705664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839671 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839655.303570:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060705664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839655.303598:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060706304:0@lo:400:kworker.0 00010000:00080000:3.0:1788839655.303608:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7766eca80 x1875734060706816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839655.303617:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060706816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.303640:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060705792 00000100:00100000:3.0:1788839655.303654:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060705792 00000100:00100000:3.0:1788839655.303684:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788839655.303691:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060705792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.303725:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060705792:12345-0@lo:400:kworker.0 Request processed in 35us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839655.303731:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788839655.303914:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060706688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.303943:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060706688:12345-0@lo:400:kworker.0 Request processed in 34us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839655.304250:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060705792:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.306662:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060706048:0@lo:400:kworker.0 00010000:00080000:3.0:1788839655.306684:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9880 x1875734060706560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839655.306694:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060706560:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.306707:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060705920:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.306719:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060706432:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.311508:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:1.0:1788839655.311562:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839655.311610:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060706176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839655.311626:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7766ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060706688:0@lo:400:kworker.0 00000100:00100000:3.0:1788839655.374878:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839655.374946:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.375177:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050132480 00000100:00100000:2.0:1788839655.375186:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050132480 00000100:00100000:3.0:1788839655.375453:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788839655.375584:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:10506:x1875734050132480:12345-192.168.203.52@tcp:700:mkdir.0 00000100:00100000:3.0:1788839655.375670:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:10506:x1875734050132480:12345-192.168.203.52@tcp:700:mkdir.0 Request processed in 207us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839655.375678:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00080000:1.0:1788839655.375883:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839655.376173:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050132352 00000100:00100000:0.0:1788839655.376179:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050132352 00000100:00100000:0.0:1788839655.376220:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788839655.376228:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050132352:12345-192.168.203.52@tcp:41:mkdir.0 00000004:00000024:0.0:1788839655.376655:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839655.376730:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050132352:12345-192.168.203.52@tcp:41:mkdir.0 Request processed in 501us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.376748:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788839655.381414:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839655.381644:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050132736 00000100:00100000:1.0:1788839655.381655:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050132736 00000100:00100000:1.0:1788839655.381720:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788839655.381731:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:10506:x1875734050132736:12345-192.168.203.52@tcp:36:mkdir.0 00010000:00010000:1.0:1788839655.381829:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839655.381874:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26572b29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74728 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.381896:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab748ac4300) 00010000:00010000:1.0:1788839655.381917:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839655.382011:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.382038:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.382048:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.382081:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.382089:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.382095:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384190:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384212:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384222:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839655.384238:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2e2951a reply state 0000000009b6273d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384250:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384257:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab748ac4100) 00010000:00010000:1.0:1788839655.384271:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839655.384275:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788839655.384280:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788839655.384288:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384295:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384302:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384308:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839655.384312:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384319:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384329:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab748ac4c00) 00010000:00010000:1.0:1788839655.384331:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839655.384335:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384341:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572c87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839655.384358:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2e2951a reply state 0000000009b6273d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384367:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.384382:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab748ac4a00) 00010000:00010000:1.0:1788839655.384385:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839655.384387:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788839655.384911:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:10506:x1875734050132736:12345-192.168.203.52@tcp:36:mkdir.0 Request processed in 3176us (3501us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788839655.384921:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788839655.416149:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.416413:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050132864 00000100:00100000:2.0:1788839655.416423:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050132864 00000100:00100000:2.0:1788839655.416526:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788839655.416537:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:10507:x1875734050132864:12345-192.168.203.52@tcp:101:chmod.0 00010000:00010000:2.0:1788839655.416558:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839655.416582:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572c9c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747bb expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.416643:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572ca3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.416656:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.416668:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839655.416720:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839655.416724:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839655.416759:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.416828:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572c9c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747bb expref: 9 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.416849:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747bb expref: 8 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.416858:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850d00) 00010000:00010000:2.0:1788839655.416861:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839655.416864:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839655.416924:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:10507:x1875734050132864:12345-192.168.203.52@tcp:101:chmod.0 Request processed in 389us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839655.416943:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788839655.419474:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839655.419560:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050133120 00000100:00100000:3.0:1788839655.419569:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050133120 00000100:00100000:3.0:1788839655.419821:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788839655.419833:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+8:10507:x1875734050133120:12345-192.168.203.52@tcp:36:chmod.0 00010000:00010000:3.0:1788839655.419883:0:7438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839655.419909:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572ca3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747bb expref: 8 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.419929:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850d00) 00010000:00010000:3.0:1788839655.419939:0:7438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839655.419960:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.419972:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.419982:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839655.420174:0:7438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096a9e681 reply state 00000000ea1e75ce transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.420196:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.420202:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:3.0:1788839655.420205:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788839655.420208:0:7438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788839655.420215:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788839655.420386:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+9:10507:x1875734050133120:12345-192.168.203.52@tcp:36:chmod.0 Request processed in 554us (918us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788839655.420393:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788839655.446056:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839655.446182:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050133248 00000100:00100000:1.0:1788839655.446192:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050133248 00000100:00100000:1.0:1788839655.446298:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1788839655.446310:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:10508:x1875734050133248:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:1.0:1788839655.446335:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839655.446357:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465600/0xad5b343a26572cb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747c2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.446423:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572cb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.446438:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.446448:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839655.446490:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788839655.446494:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839655.446534:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.446570:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465600/0xad5b343a26572cb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747c2 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.446585:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747c2 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.446591:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:1.0:1788839655.446593:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839655.446595:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab741464e00, rc 0) 00000100:00100000:1.0:1788839655.446692:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+10:10508:x1875734050133248:12345-192.168.203.52@tcp:101:chown.0 Request processed in 384us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.446699:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1788839655.453682:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.453813:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050133376 00000100:00100000:2.0:1788839655.453823:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050133376 00000100:00100000:2.0:1788839655.453941:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788839655.453952:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+10:10508:x1875734050133376:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:2.0:1788839655.453973:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839655.454002:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572cbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747c9 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454082:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454110:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454129:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454149:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454158:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454165:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454268:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572cd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454276:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454284:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839655.454340:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839655.454344:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839655.454367:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454380:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454397:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454405:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454410:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.454414:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454420:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454430:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839655.454432:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839655.454436:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454443:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454458:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454464:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454470:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454475:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.454483:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454490:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454498:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab748ac4a00) 00010000:00010000:2.0:1788839655.454501:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839655.454504:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454509:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ccd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454535:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572cbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747c9 expref: 12 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454549:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747c9 expref: 11 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.454556:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab748ac4100) 00010000:00010000:2.0:1788839655.454558:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839655.454565:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839655.454676:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+11:10508:x1875734050133376:12345-192.168.203.52@tcp:101:chown.0 Request processed in 721us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839655.454683:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788839655.459965:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839655.460096:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050133504 00000100:00100000:0.0:1788839655.460106:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050133504 00000100:00100000:0.0:1788839655.460170:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788839655.460182:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c22f38d-5944-4459-a83e-bcbd490346fb+11:10508:x1875734050133504:12345-192.168.203.52@tcp:900:chown.0 00000100:00100000:0.0:1788839655.460275:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4c22f38d-5944-4459-a83e-bcbd490346fb+11:10508:x1875734050133504:12345-192.168.203.52@tcp:900:chown.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.460284:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788839655.469159:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839655.470812:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050133760 00000100:00100000:0.0:1788839655.470826:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050133760 00000100:00100000:0.0:1788839655.470962:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1788839655.470976:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+11:10508:x1875734050133760:12345-192.168.203.52@tcp:36:chown.0 00010000:00010000:0.0:1788839655.471044:0:7438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839655.471072:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572cd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747c9 expref: 11 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.471096:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab748ac4100) 00010000:00010000:0.0:1788839655.471101:0:7438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839655.471124:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.471139:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.471149:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839655.477412:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788839655.477524:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477546:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477554:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477560:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741465400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839655.477565:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477573:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477591:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab748ac4a00) 00010000:00010000:0.0:1788839655.477594:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839655.477599:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477605:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572c8e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477627:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477632:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477639:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477657:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839655.477661:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477667:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477676:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab748ac4100) 00010000:00010000:0.0:1788839655.477678:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839655.477681:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477686:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572c95 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477702:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477708:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477714:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477719:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839655.477722:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477728:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477746:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:0.0:1788839655.477749:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788839655.477752:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.477757:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572caa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839655.480326:0:7438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e23f3282 reply state 00000000b6918cb8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.480373:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.480383:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab748ac4100) 00010000:00010000:2.0:1788839655.480386:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788839655.480389:0:7438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788839655.480402:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788839655.480511:0:7438:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788839655.480537:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:10508:x1875734050133760:12345-192.168.203.52@tcp:36:chown.0 Request processed in 9561us (11384us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788839655.480547:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:1.0:1788839655.480611:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.480622:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.480630:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.480636:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfcc00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839655.480641:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.480649:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.480670:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab748ac4100) 00010000:00010000:1.0:1788839655.480673:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788839655.480677:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.480683:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26572cdb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839655.503327:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839655.503394:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050133888 00000100:00100000:1.0:1788839655.503404:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050133888 00000100:00100000:1.0:1788839655.503569:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1788839655.503579:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:10509:x1875734050133888:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:1.0:1788839655.503597:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839655.503613:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465600/0xad5b343a26572ce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747d0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839655.505915:0:6488:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2262us 00010000:00010000:2.0:1788839655.522090:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522114:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522125:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522142:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522149:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522155:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522287:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522296:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522303:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839655.522337:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839655.522341:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839655.522376:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522389:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522396:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522402:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522408:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.522413:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522421:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522433:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839655.522443:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839655.522458:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522465:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522478:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522484:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522490:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522495:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.522497:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522503:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522510:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab647850a00) 00010000:00010000:2.0:1788839655.522512:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839655.522515:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522520:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572cf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522566:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465600/0xad5b343a26572ce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747d0 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522595:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747d0 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.522602:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:2.0:1788839655.522604:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788839655.522606:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842a00, rc 0) 00000100:00100000:2.0:1788839655.522677:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:10509:x1875734050133888:12345-192.168.203.52@tcp:101:touch.500 Request processed in 19099us (19359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839655.522684:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1788839655.525624:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.526076:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050134144 00000100:00100000:2.0:1788839655.526086:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050134144 00000100:00100000:2.0:1788839655.526132:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788839655.526142:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:10509:x1875734050134144:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1788839655.526162:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839655.526181:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572cfe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747d7 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526280:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526295:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526304:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526315:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526332:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526338:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839655.526692:0:12241:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788839655.526838:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526846:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526858:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526886:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526892:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526898:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.526903:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.526907:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.527655:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.527683:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:2.0:1788839655.527686:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839655.527691:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.527697:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839655.527712:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b4064846 reply state 00000000892b63f5 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.527721:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.527726:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff8ab647850200) 00010000:00010000:2.0:1788839655.527728:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839655.527731:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788839655.527764:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572cfe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747d7 expref: 10 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.529253:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747d7 expref: 9 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.529265:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850600) 00010000:00010000:2.0:1788839655.529269:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839655.529272:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843c00, rc 0) 00000100:00100000:2.0:1788839655.530118:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+10:10509:x1875734050134144:12345-192.168.203.52@tcp:101:touch.500 Request processed in 3972us (4497us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788839655.530129:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788839655.537597:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.539453:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050134400 00000100:00100000:2.0:1788839655.539467:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050134400 00000100:00100000:2.0:1788839655.539535:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1788839655.539546:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+10:10509:x1875734050134400:12345-192.168.203.52@tcp:36:touch.500 00010000:00010000:2.0:1788839655.539807:0:7438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839655.539834:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747d7 expref: 10 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.539917:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850600) 00010000:00010000:2.0:1788839655.539929:0:7438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839655.539976:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.540000:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.540011:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839655.540840:0:7438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f381bf5 reply state 000000008c7a09b1 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.541189:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.541197:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:2.0:1788839655.541199:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839655.541203:0:7438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839655.541372:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+11:10509:x1875734050134400:12345-192.168.203.52@tcp:36:touch.500 Request processed in 1824us (3782us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788839655.541396:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1788839655.556158:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.556549:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050134528 00000100:00100000:2.0:1788839655.556559:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050134528 00000100:00100000:2.0:1788839655.556615:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1788839655.556625:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+11:10509:x1875734050134528:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1788839655.556648:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839655.556669:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747de expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.556720:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747de expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.556733:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747de expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.556750:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:2.0:1788839655.556753:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839655.556824:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:2.0:1788839655.556887:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+12:10509:x1875734050134528:12345-192.168.203.52@tcp:101:touch.500 Request processed in 263us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839655.556894:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788839655.560843:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839655.561081:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050134656 00000100:00100000:0.0:1788839655.561090:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050134656 00000100:00100000:0.0:1788839655.561137:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788839655.561145:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2388:x1875734050134656:12345-192.168.203.52@tcp:8:touch.500 00010000:00080000:0.0:1788839655.561177:0:8404:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 310 last 0 00000020:00000080:0.0:1788839655.561205:0:8404:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26572d2f 00002000:00100000:0.0:1788839655.561217:0:8404:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c22f38d-5944-4459-a83e-bcbd490346fb/ffff8ab777c22800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788839655.561228:0:8404:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:0.0:1788839655.561298:0:8404:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788839655.561325:0:8404:0:(import.c:65:import_set_state_nolock()) ffff8ab777c26800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839655.561395:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050134656:12345-192.168.203.52@tcp:8:touch.500 Request processed in 249us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.561402:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788839655.570627:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839655.570710:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050134784 00000100:00100000:1.0:1788839655.570718:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050134784 00000100:00100000:1.0:1788839655.570821:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788839655.570830:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:0:x1875734050134784:12345-192.168.203.52@tcp:2:touch.500 00000100:00080000:2.0:1788839655.571185:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788839655.574487:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:0.0:1788839655.574501:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000100:00100000:1.0:1788839655.575385:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:0:x1875734050134784:12345-192.168.203.52@tcp:2:touch.500 Request processed in 4548us (4759us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788839655.575397:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788839655.578030:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.578164:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050135040 00000100:00100000:2.0:1788839655.578179:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050135040 00000100:00100000:2.0:1788839655.578263:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788839655.578283:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+12:10509:x1875734050135040:12345-192.168.203.52@tcp:35:touch.500 00000100:00100000:2.0:1788839655.578646:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+13:10509:x1875734050135040:12345-192.168.203.52@tcp:35:touch.500 Request processed in 370us (622us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788839655.578654:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788839655.602480:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.603219:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050135168 00000100:00100000:2.0:1788839655.603230:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050135168 00000100:00100000:2.0:1788839655.603294:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788839655.603305:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+13:10510:x1875734050135168:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:2.0:1788839655.603333:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839655.603356:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747e5 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.603422:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572d3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.603436:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.603447:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839655.603488:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839655.603491:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839655.603528:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572d3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.603553:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747e5 expref: 15 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.603572:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572d3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747e5 expref: 14 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.603594:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:2.0:1788839655.603597:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839655.603601:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842e00, rc 0) 00000100:00100000:2.0:1788839655.603668:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+14:10510:x1875734050135168:12345-192.168.203.52@tcp:101:rm.0 Request processed in 365us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839655.603676:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788839655.626809:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.627014:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050135424 00000100:00100000:2.0:1788839655.627025:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050135424 00000100:00100000:2.0:1788839655.627092:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1788839655.627102:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+14:10510:x1875734050135424:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:2.0:1788839655.627123:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839655.627144:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747ec expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839655.627244:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839655.627347:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ec expref: 16 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.627362:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839655.627365:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839655.627371:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ec expref: 16 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.627386:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843c00, rc 0) 00000100:00100000:2.0:1788839655.627449:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+15:10510:x1875734050135424:12345-192.168.203.52@tcp:101:rm.0 Request processed in 348us (701us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788839655.627475:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788839655.637571:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.637681:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050135552 00000100:00100000:2.0:1788839655.637691:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050135552 00000100:00100000:2.0:1788839655.637753:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788839655.637763:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+15:10510:x1875734050135552:12345-192.168.203.52@tcp:37:rm.0 00000100:00100000:2.0:1788839655.645426:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+15:10510:x1875734050135552:12345-192.168.203.52@tcp:37:rm.0 Request processed in 7653us (7853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839655.645440:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788839655.652584:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839655.652669:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050135808 00000100:00100000:0.0:1788839655.652679:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050135808 00000100:00100000:0.0:1788839655.652753:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788839655.652763:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+15:10510:x1875734050135808:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:0.0:1788839655.653164:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:10510:x1875734050135808:12345-192.168.203.52@tcp:35:rm.0 Request processed in 401us (589us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788839655.653294:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788839655.657144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839655.661166:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050136064 00000100:00100000:0.0:1788839655.661181:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050136064 00000100:00100000:0.0:1788839655.661256:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788839655.661266:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:10510:x1875734050136064:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:0.0:1788839655.661290:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839655.661309:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26572d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747f3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.661418:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a26572d59 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.661429:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a26572d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.661437:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a26572d59 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839655.661444:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788839655.661562:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26572d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747f3 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.661576:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a26572d59 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747f3 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839655.661591:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:0.0:1788839655.661593:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839655.661595:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd000, rc 0) 00000100:00100000:0.0:1788839655.661656:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050136064:12345-192.168.203.52@tcp:101:rm.0 Request processed in 392us (4522us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788839655.661663:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788839655.666230:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839655.666420:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050136192 00000100:00100000:1.0:1788839655.666429:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050136192 00000100:00100000:1.0:1788839655.666523:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788839655.666533:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050136192:12345-192.168.203.52@tcp:41:rm.0 00000004:00000024:1.0:1788839655.666595:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788839655.666668:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050136192:12345-192.168.203.52@tcp:41:rm.0 Request processed in 137us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.666675:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788839655.670516:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839655.670676:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050136320 00000100:00100000:1.0:1788839655.670687:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050136320 00000100:00100000:1.0:1788839655.670744:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1788839655.670754:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050136320:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1788839655.670804:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839655.670832:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465600/0xad5b343a26572d67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e747fa expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.670895:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671091:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671102:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671124:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671131:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671138:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671244:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671252:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671259:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839655.671298:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788839655.671302:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839655.671319:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671329:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671336:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671342:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671461:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671468:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839655.671472:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671479:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671497:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:1.0:1788839655.671500:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839655.671504:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671510:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464400/0xad5b343a26572d6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671524:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671530:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671536:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671541:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741465400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839655.671544:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671551:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671558:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff8ab647850200) 00010000:00010000:1.0:1788839655.671560:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839655.671563:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671569:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465400/0xad5b343a26572d75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671610:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741465600/0xad5b343a26572d67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747fa expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671624:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747fa expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839655.671631:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:1.0:1788839655.671633:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839655.671636:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959a00, rc 0) 00000100:00100000:1.0:1788839655.671749:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:10510:x1875734050136320:12345-192.168.203.52@tcp:101:rm.0 Request processed in 997us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839655.671756:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788839655.677691:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.677767:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050136576 00000100:00100000:2.0:1788839655.677802:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050136576 00000100:00100000:2.0:1788839655.677856:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788839655.677865:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+19:10510:x1875734050136576:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:2.0:1788839655.677927:0:12241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788839655.677954:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26572d7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747fa expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.677985:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26572d28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747de expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678006:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:2.0:1788839655.678016:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572d3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747e5 expref: 17 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678024:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:2.0:1788839655.678027:0:12241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839655.678064:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678078:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678088:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678098:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678123:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678130:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678251:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678260:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678267:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839655.678500:0:12241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788839655.678509:0:12241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310622738424ns, next at 311622736545ns, rc = 0 00010000:00010000:2.0:1788839655.678554:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678562:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678575:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678583:0:12241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678589:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678594:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678617:0:12241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839655.678635:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839655.678640:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678646:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413caa00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839655.678649:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678657:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678665:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:2.0:1788839655.678667:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788839655.678670:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678675:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572d98 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678696:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839655.678698:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839655.678700:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839655.678713:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678719:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678725:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678729:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.678732:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678737:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678745:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:2.0:1788839655.678747:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788839655.678750:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678756:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572d91 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678793:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678799:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678811:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678817:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839655.678820:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678826:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678835:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:2.0:1788839655.678837:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839655.678840:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678846:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572d83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839655.678857:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051b56ce3 reply state 00000000a01e4d71 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678867:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839655.678873:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff8ab647850200) 00010000:00010000:2.0:1788839655.678875:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839655.678878:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839655.679619:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050136576:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1750us (1933us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788839655.679629:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788839655.683310:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839655.686210:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050136832 00000100:00100000:2.0:1788839655.686225:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050136832 00000100:00100000:2.0:1788839655.686427:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788839655.686439:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050136832:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:2.0:1788839655.686667:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:10510:x1875734050136832:12345-192.168.203.52@tcp:35:rm.0 Request processed in 230us (3366us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788839655.686673:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788839655.689605:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839655.689894:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137088 00000100:00100000:3.0:1788839655.689926:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137088 00000100:00100000:3.0:1788839655.690026:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1788839655.690037:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+19:10510:x1875734050137088:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788839655.690094:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788839655.690319:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a26572d59 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747f3 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690340:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26572cf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747d0 expref: 18 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690421:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab647850300) 00010000:00010000:3.0:1788839655.690440:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab741464e00/0xad5b343a26572cb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747c2 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690452:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:3.0:1788839655.690458:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839655.690480:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690492:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690500:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690511:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690518:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690536:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690632:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690639:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.690646:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839655.690884:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788839655.691033:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691041:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691048:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691053:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839655.691057:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691065:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691075:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8ab64784f800) 00010000:00010000:3.0:1788839655.691078:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788839655.691089:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691096:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26572dad lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691258:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691265:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691270:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691274:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839655.691277:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691282:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691289:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab64784f100) 00010000:00010000:3.0:1788839655.691291:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839655.691293:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691298:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572d9f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839655.691307:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf5a970b reply state 00000000114b59fe transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691327:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839655.691333:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab64784f000) 00010000:00010000:3.0:1788839655.691335:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839655.691338:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839655.691606:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+18:10510:x1875734050137088:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1568us (2008us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788839655.691614:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788839655.807891:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839655.807916:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060706944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839655.807998:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839655.809795:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060706944 00000100:00100000:0.0:1788839655.810255:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060706944 00000100:00100000:0.0:1788839655.810339:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788839655.810349:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060706944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839655.810382:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839655.810888:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7766eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060706944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 540us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839655.810897:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788839655.811048:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060706944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839656.104308:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839656.104350:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839656.104383:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839656.104414:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137472 00000100:00100000:0.0:1788839656.104421:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839656.104426:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137472 00000100:00100000:1.0:1788839656.104483:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137728 00000100:00100000:1.0:1788839656.104486:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137728 00000100:00100000:1.0:1788839656.104504:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137344 00000100:00100000:1.0:1788839656.104506:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137344 00000100:00100000:1.0:1788839656.104521:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:1.0:1788839656.104530:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050137472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839656.104620:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050137472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 90us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839656.104644:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:1.0:1788839656.104675:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:1.0:1788839656.104683:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050137728:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839656.104710:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050137728:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839656.104716:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:1.0:1788839656.104727:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:1.0:1788839656.104734:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2392:x1875734050137344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839656.104761:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2392:x1875734050137344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839656.104767:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:0.0:1788839656.105999:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839656.106061:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839656.106148:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137216 00000100:00100000:2.0:1788839656.106156:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137216 00000100:00100000:2.0:1788839656.106202:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 339 00000100:00100000:2.0:1788839656.106211:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050137216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839656.106266:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050137216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 56us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839656.106273:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 339 00000100:00080000:2.0:1788839656.106314:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839656.106319:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839656.106396:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137856 00000100:00100000:2.0:1788839656.106399:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137856 00000100:00080000:2.0:1788839656.106415:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839656.106443:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:2.0:1788839656.106636:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050137856:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839656.106673:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050137856:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839656.106680:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:3.0:1788839656.106800:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137600 00000100:00100000:3.0:1788839656.106806:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137600 00000100:00100000:3.0:1788839656.106845:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788839656.106852:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050137600:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839656.106885:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050137600:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839656.106891:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:1.0:1788839656.256819:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839657.279074:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839657.859632:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839657.859654:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060707072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839657.859721:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839657.859805:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707072 00000100:00100000:0.0:1788839657.859813:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707072 00000100:00100000:0.0:1788839657.859871:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788839657.859881:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060707072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839657.859912:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839657.859953:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060707072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839657.859981:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788839657.860035:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060707072:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788839658.305253:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839659.328049:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788839659.475384:0:13651:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788839660.353735:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839660.416169:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060707200:0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.416263:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.416332:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839660.416339:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060707328:0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.416368:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.416422:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707200 00000100:00100000:1.0:1788839660.416429:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707200 00000100:00100000:1.0:1788839660.416473:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788839660.416482:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060707200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.416536:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060707200:12345-0@lo:400:kworker.0 Request processed in 56us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.416556:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788839660.416589:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707328 00000100:00100000:1.0:1788839660.416593:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707328 00000100:00100000:1.0:1788839660.416621:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788839660.416627:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060707328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.416660:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060707328:12345-0@lo:400:kworker.0 Request processed in 32us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.416666:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788839660.416689:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060707712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839660.416714:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.416750:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060707328:0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.416760:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060707200:0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.416810:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707712 00000100:00100000:1.0:1788839660.416814:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707712 00000100:00100000:1.0:1788839660.416847:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788839660.416854:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060707712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839660.416879:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839660.416914:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060707712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.416920:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:1.0:1788839660.416947:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443dad80 x1875734060707712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839660.416970:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060707712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839660.416981:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839660.416993:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060707840:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788839660.416998:0:9815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 315361226716ns, next at 316361224368ns, rc = 0 00000100:00100000:1.0:1788839660.417015:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.417041:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707840 00000100:00100000:1.0:1788839660.417045:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707840 00000100:00100000:1.0:1788839660.418657:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788839660.418677:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060707840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839660.418706:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839660.418794:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060707840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.418801:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1788839660.419400:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af5500 x1875734060707840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839660.419422:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060707840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839660.423804:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060708352:0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.423985:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839660.424430:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060707456:0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.424572:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839660.424574:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060708864:0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.424602:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060707968:0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.424610:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839660.424640:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788839660.424640:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839660.424649:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060708224:0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.424672:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060708480:0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.424680:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839660.424702:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060708736:0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.424709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839660.424793:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060707584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839660.426286:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839660.426369:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839660.426376:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839660.426421:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708352 00000100:00100000:2.0:1788839660.426430:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708352 00000100:00100000:0.0:1788839660.426459:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060708992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839660.426483:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707968 00000100:00100000:2.0:1788839660.426487:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707968 00000100:00100000:2.0:1788839660.426506:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708224 00000100:00100000:2.0:1788839660.426509:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708224 00000100:00100000:2.0:1788839660.426522:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708736 00000100:00100000:2.0:1788839660.426525:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708736 00000100:00100000:0.0:1788839660.426529:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839660.426548:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788839660.426558:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060708352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.426578:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707456 00000100:00100000:0.0:1788839660.426583:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707456 00000100:00100000:2.0:1788839660.426622:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060708352:12345-0@lo:400:kworker.0 Request processed in 64us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839660.426623:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788839660.426637:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788839660.426638:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060707456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.426658:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788839660.426666:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060707968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.426688:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060707456:12345-0@lo:400:kworker.0 Request processed in 53us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839660.426695:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788839660.426710:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060707968:12345-0@lo:400:kworker.0 Request processed in 45us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839660.426718:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788839660.426724:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788839660.426735:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060708224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.426736:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788839660.426746:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060708736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.426813:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060708736:12345-0@lo:400:kworker.0 Request processed in 69us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839660.426818:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788839660.426834:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708864 00000100:00100000:2.0:1788839660.426837:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708864 00000100:00100000:2.0:1788839660.426859:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708480 00000100:00100000:2.0:1788839660.426861:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708480 00000100:00100000:2.0:1788839660.426877:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788839660.426883:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060708864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.426907:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060708864:12345-0@lo:400:kworker.0 Request processed in 25us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839660.426913:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788839660.426921:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788839660.426926:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060708480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.426945:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060708480:12345-0@lo:400:kworker.0 Request processed in 20us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839660.426950:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788839660.426976:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839660.426978:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839660.426980:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839660.426982:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839660.427009:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060708224:0@lo:400:kworker.0 00010000:00080000:2.0:1788839660.427028:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c37480 x1875734060708736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839660.427039:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060708736:0@lo:400:kworker.0 00010000:00080000:2.0:1788839660.427049:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c34a80 x1875734060708352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839660.427056:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060708352:0@lo:400:kworker.0 00010000:00080000:2.0:1788839660.427064:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c35500 x1875734060708864/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839660.427071:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060708864:0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.427408:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060708224:12345-0@lo:400:kworker.0 Request processed in 78us (2134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839660.427417:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788839660.427445:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708992 00000100:00100000:0.0:1788839660.427449:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708992 00000100:00100000:0.0:1788839660.427486:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788839660.427495:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060708992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839660.427513:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839660.427553:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060708992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839660.427558:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1788839660.427589:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a31180 x1875734060708992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839660.427604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060708992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839660.427615:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060707456:0@lo:400:kworker.0 00000100:00100000:0.0:1788839660.427626:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060707968:0@lo:400:kworker.0 00010000:00080000:0.0:1788839660.427636:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c35180 x1875734060708480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839660.427644:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060708480:0@lo:400:kworker.0 00000100:00100000:3.0:1788839660.433668:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839660.434863:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060707584 00000100:00100000:2.0:1788839660.434874:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060707584 00000100:00100000:2.0:1788839660.434930:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788839660.435078:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060707584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839660.435120:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839660.435181:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060707584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 243us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839660.435189:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788839660.435280:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060708096:0@lo:400:kworker.0 00000100:00100000:3.0:1788839660.435388:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839660.435422:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060708608:0@lo:400:kworker.0 00000100:00100000:3.0:1788839660.435446:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788839660.435559:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a31c00 x1875734060707584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839676 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839660.435581:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060707584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839660.435663:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708096 00000100:00100000:1.0:1788839660.435669:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708096 00000100:00100000:1.0:1788839660.435708:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788839660.435717:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060708096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839660.435764:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060708096:12345-0@lo:400:kworker.0 Request processed in 49us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.435797:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788839660.435838:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060708608 00000100:00100000:2.0:1788839660.435844:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060708608 00000100:00100000:2.0:1788839660.435886:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788839660.435893:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060708608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839660.435928:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060708608:12345-0@lo:400:kworker.0 Request processed in 36us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839660.435934:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788839660.436616:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060708096:0@lo:400:kworker.0 00000100:00100000:3.0:1788839660.436631:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060708608:0@lo:400:kworker.0 00000100:00080000:1.0:1788839660.436690:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788839660.501926:0:13699:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2dff71c0 20000000:00000080:0.0:1788839660.501944:0:13699:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab647b5bc00 uarg=0000000000000000 20000000:01000000:0.0:1788839660.501998:0:13699:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788839660.502004:0:13699:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788839660.502009:0:13699:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788839660.502698:0:13700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788839660.502983:0:13699:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788839660.508385:0:13699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788839660.508423:0:13699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788839660.508437:0:13699:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788839660.508453:0:13699:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788839660.508470:0:13699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508504:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c41 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508521:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c4f expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508529:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c5d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508536:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572c6b expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508545:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508552:0:13699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508559:0:13699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508597:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508611:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 12 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.508625:0:13699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709120:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839660.508722:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508736:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 12 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.508745:0:13699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709248:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839660.508799:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572c6b expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.508808:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572c6b expref: 23 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.508816:0:13699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709376:0@lo:104: 00000100:00100000:1.0:1788839660.509105:0:13699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839660.514172:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572c5d expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.514191:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572c5d expref: 23 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.514206:0:13699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709504:0@lo:104: 00010000:00010000:1.0:1788839660.514273:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572c4f expref: 23 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.514281:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572c4f expref: 23 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.514288:0:13699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709632:0@lo:104: 00010000:00010000:1.0:1788839660.514335:0:13699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26572c41 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.514349:0:13699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26572c41 expref: 23 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.514357:0:13699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709760:0@lo:104: 00000100:00100000:1.0:1788839660.514376:0:13699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788839660.518462:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839660.518626:0:13699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709120:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839660.518637:0:13699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709248:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839660.518688:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050137984 00000100:00100000:3.0:1788839660.518696:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050137984 00010000:00010000:3.0:1788839660.518733:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 13 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.518800:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788839660.518810:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050137984:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839660.518825:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839660.518831:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 13 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.518969:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839660.518996:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138112 00000100:00100000:1.0:1788839660.519000:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138112 00010000:00010000:1.0:1788839660.519017:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 14 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.519044:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1788839660.519051:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a94babf6-f8ea-4a10-a503-aad078d53639+14:2389:x1875734050138112:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839660.519059:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839660.519062:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 14 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.519213:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 13 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.519398:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 14 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.519416:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843a00/0xad5b343a26572c79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747ad expref: 14 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.519451:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839660.519501:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050138112:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 450us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.519534:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00010000:00010000:3.0:1788839660.519730:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078a00/0xad5b343a26572c80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e747b4 expref: 12 pid: 6479 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.519742:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839660.519764:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050137984:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 956us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839660.519926:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788839660.520992:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788839660.521028:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.521072:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.521089:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.521098:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060709376 00000100:00100000:1.0:1788839660.521105:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060709376 00000100:00100000:1.0:1788839660.521136:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060709504 00000100:00100000:1.0:1788839660.521139:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060709504 00000100:00100000:1.0:1788839660.521147:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060709632 00000100:00100000:1.0:1788839660.521149:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060709632 00000100:00100000:1.0:1788839660.521157:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060709760 00000100:00100000:1.0:1788839660.521160:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060709760 00000100:00100000:1.0:1788839660.521170:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839660.521197:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+6:13699:x1875734060709376:12345-0@lo:104: 00010000:00010000:1.0:1788839660.521212:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521273:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839660.521279:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+6:13699:x1875734060709376:12345-0@lo:104: Request processed in 92us (12175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.521286:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788839660.521333:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839660.521339:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521347:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839660.521353:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521372:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839660.521379:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839660.521384:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839660.521417:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521424:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839660.521444:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521451:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7400/0xad5b343a26572c6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c72 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521463:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839660.521465:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839660.521466:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839660.521478:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788839660.521484:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+5:13699:x1875734060709504:12345-0@lo:104: 00010000:00010000:1.0:1788839660.521492:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521526:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839660.521531:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+5:13699:x1875734060709504:12345-0@lo:104: Request processed in 48us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.521535:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:1.0:1788839660.521556:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839660.521560:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521567:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839660.521570:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521576:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839660.521581:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839660.521586:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839660.521599:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521604:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839660.521620:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521626:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782079200/0xad5b343a26572c5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c64 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521635:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839660.521636:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839660.521638:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839660.521653:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060710016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839660.521684:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.521734:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710016 00000100:00100000:1.0:1788839660.521743:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710016 00010000:00010000:1.0:1788839660.521760:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c5d expref: 24 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.521806:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839660.521813:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060710016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839660.521823:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839660.521828:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c5d expref: 24 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521837:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572c5d expref: 24 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.521867:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839660.521896:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060710016:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.521902:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839660.521940:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060710016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839660.521972:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788839660.521978:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:13699:x1875734060709632:12345-0@lo:104: 00010000:00010000:1.0:1788839660.521986:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522020:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839660.522026:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+4:13699:x1875734060709632:12345-0@lo:104: Request processed in 48us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.522032:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788839660.522044:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788839660.522047:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839660.522059:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839660.522060:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060709888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839660.522072:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839660.522075:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522083:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839660.522090:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839660.522095:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788839660.522110:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522116:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839660.522128:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522133:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078c00/0xad5b343a26572c4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c56 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522143:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839660.522144:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839660.522146:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839660.522155:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060710144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839660.522180:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839660.522218:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710144 00000100:00100000:1.0:1788839660.522223:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710144 00000100:00100000:0.0:1788839660.522226:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839660.522247:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c4f expref: 24 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.522273:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060709888 00000100:00100000:1.0:1788839660.522277:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060709888 00010000:00010000:1.0:1788839660.522288:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c6b expref: 25 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.522310:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839660.522316:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+25:3615:x1875734060710144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839660.522324:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839660.522329:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c4f expref: 25 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522341:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572c4f expref: 25 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839660.522341:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839660.522355:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+25:3616:x1875734060709888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839660.522357:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839660.522367:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839660.522374:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c6b expref: 25 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.522386:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572c6b expref: 25 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.522394:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:096dcd45-3d06-4359-b81b-4bde04036a06+25:3615:x1875734060710144:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (211us total) trans 0 rc 0/0 00010000:00010000:0.0:1788839660.522401:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839660.522404:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839660.522438:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060709888:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.522443:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060710144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839660.522449:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839660.522470:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788839660.522480:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:13699:x1875734060709760:12345-0@lo:104: 00000100:00100000:0.0:1788839660.522487:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060709888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839660.522489:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.522540:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839660.522546:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:096dcd45-3d06-4359-b81b-4bde04036a06+3:13699:x1875734060709760:12345-0@lo:104: Request processed in 69us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839660.522562:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788839660.522683:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839660.522689:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.522696:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839660.522700:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.522707:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839660.522723:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839660.522728:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839660.522743:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.522748:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839660.522765:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.522857:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab782078200/0xad5b343a26572c41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26572c48 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.522873:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839660.522875:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839660.522878:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788839660.522878:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839660.522891:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060710272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839660.522921:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839660.522970:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710272 00000100:00100000:3.0:1788839660.522981:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710272 00010000:00010000:3.0:1788839660.522999:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c41 expref: 24 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.523029:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788839660.523035:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060710272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839660.523044:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839660.523048:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26572c41 expref: 24 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523057:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26572c41 expref: 24 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523071:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523079:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523093:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523101:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523109:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523116:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523122:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839660.523132:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523140:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523149:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523159:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839660.523199:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060710272:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839660.523206:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788839660.523238:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060710272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839660.523283:0:13699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078000/0xad5b343a26572c72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572c6b expref: 23 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.523437:0:13699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709376:0@lo:104: 00010000:00010000:3.0:1788839660.523454:0:13699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843200/0xad5b343a26572c64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572c5d expref: 22 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.523465:0:13699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709504:0@lo:104: 00010000:00010000:3.0:1788839660.523474:0:13699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842000/0xad5b343a26572c56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572c4f expref: 21 pid: 6480 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.523481:0:13699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709632:0@lo:104: 00010000:00010000:3.0:1788839660.523490:0:13699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572c48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26572c41 expref: 20 pid: 6481 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.523510:0:13699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13699:1875734060709760:0@lo:104: 00010000:00010000:3.0:1788839660.523535:0:13699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523543:0:13699:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523550:0:13699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.523556:0:13699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647958e00/0xad5b343a26572db4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839660.927599:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060710400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839660.927671:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839660.928127:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710400 00000100:00100000:0.0:1788839660.928135:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710400 00000100:00100000:0.0:1788839660.928184:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788839660.928203:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060710400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839660.928239:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839660.928305:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060710400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839660.928311:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788839660.928442:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060710400:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1788839660.933433:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788839660.933473:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788839660.933482:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788839660.933552:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933565:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933573:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933579:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839660.933583:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933591:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933607:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff8ab647850200) 00010000:00010000:1.0:1788839660.933610:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839660.933614:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933620:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26572d0c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933640:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933646:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933669:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933674:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839660.933677:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933684:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933692:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8ab647850a00) 00010000:00010000:1.0:1788839660.933695:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839660.933697:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933702:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572d21 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933733:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933740:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933746:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933751:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839660.933754:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933814:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933824:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x22313a05 (ffff8ab647850200) 00010000:00010000:1.0:1788839660.933826:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839660.933829:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933835:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572d8a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x22313a05 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933850:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933856:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933862:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933867:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839660.933870:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933876:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933882:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab64784f000) 00010000:00010000:1.0:1788839660.933884:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839660.933887:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839660.933898:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572da6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839660.935761:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060710528:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788839660.935857:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839660.943044:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710528 00000100:00100000:0.0:1788839660.943059:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710528 00000100:00100000:0.0:1788839660.943127:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839660.943137:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060710528:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788839660.943181:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788839660.943216:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f86e6, atime: 0x6a9f86e6, ctime: 0x6a9f86e6, blocks: 0x0 00010000:00010000:0.0:1788839660.943223:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.943241:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1788839660.943244:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839660.943250:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.943266:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.943277:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.943286:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839660.943307:0:8404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788839660.943475:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060710528:12345-0@lo:6:osp-syn-1-0.0 Request processed in 339us (7617us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788839660.943482:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:0.0:1788839660.943528:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab64783e300/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788839660.943534:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060710528:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788839660.944035:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839660.944042:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.944050:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839660.944055:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.944064:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.944091:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.944098:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7aad56a/0xad5b343a26572dbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839660.944117:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839660.944119:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839660.944121:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839661.232901:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839661.232974:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839661.233282:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839661.233316:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839661.233341:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839661.233363:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839661.233389:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138496 00000100:00100000:0.0:1788839661.233397:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138496 00000100:00100000:1.0:1788839661.234374:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138752 00000100:00100000:1.0:1788839661.234382:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138752 00000100:00100000:2.0:1788839661.234447:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138368 00000100:00100000:2.0:1788839661.234452:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138368 00000100:00100000:3.0:1788839661.234488:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138240 00000100:00100000:3.0:1788839661.234492:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138240 00000100:00100000:0.0:1788839661.237346:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138880 00000100:00100000:0.0:1788839661.237359:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138880 00000100:00100000:3.0:1788839661.237436:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 341 00000100:00100000:3.0:1788839661.237450:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050138240:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839661.237533:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050138240:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 87us (4641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839661.237541:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 341 00000100:00100000:3.0:1788839661.237711:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:3.0:1788839661.237720:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050138496:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839661.237756:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050138496:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (4782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839661.237763:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:3.0:1788839661.237801:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050138624 00000100:00100000:3.0:1788839661.237805:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050138624 00000100:00100000:1.0:1788839661.241635:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:1.0:1788839661.241654:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050138752:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839661.241729:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050138752:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (8446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839661.241736:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00080000:1.0:1788839661.241781:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839661.241787:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839661.241789:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839661.247162:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:2.0:1788839661.247182:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050138368:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839661.247273:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050138368:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 99us (13956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839661.247280:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:2.0:1788839661.255310:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:2.0:1788839661.255327:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050138880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839661.255423:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050138880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 101us (22058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839661.255432:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:2.0:1788839661.256050:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788839661.256061:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050138624:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839661.256110:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050138624:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (22767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839661.256117:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00010000:00010000:3.0:1788839661.381582:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788839661.500548:0:13748:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3244e7a0 20000000:00000080:0.0:1788839661.500569:0:13748:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab647b58000 uarg=0000000000000000 20000000:01000000:0.0:1788839661.500615:0:13748:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788839661.500621:0:13748:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788839661.500626:0:13748:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788839661.501119:0:13749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788839661.501275:0:13748:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788839661.501556:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788839661.501589:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788839661.501603:0:13748:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788839661.501616:0:13748:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788839661.501637:0:13748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501652:0:13748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501663:0:13748:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501671:0:13748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501677:0:13748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501697:0:13748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501703:0:13748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839661.501707:0:13748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501714:0:13748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501726:0:13748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501734:0:13748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839661.501740:0:13748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfda00/0xad5b343a26572dc2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839661.992162:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839661.992497:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139008 00000100:00100000:2.0:1788839661.992506:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139008 00000100:00100000:2.0:1788839661.992576:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 342 00000100:00100000:2.0:1788839661.992586:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+11:6165:x1875734050139008:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839661.992605:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839661.992626:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413cba00/0xad5b343a26572dc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74801 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839661.992656:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413cba00/0xad5b343a26572dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74801 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839661.992667:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413cba00/0xad5b343a26572dc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74801 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839661.992676:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413cba00, rc 0) 00000100:00100000:2.0:1788839661.992746:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050139008:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 160us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839661.992753:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 342 00000100:00100000:1.0:1788839661.996755:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839661.996880:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139136 00000100:00100000:2.0:1788839661.996889:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139136 00000100:00100000:2.0:1788839661.997024:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 343 00000100:00100000:2.0:1788839661.997036:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050139136:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839661.997230:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050139136:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 197us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839661.997238:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 343 00000100:00100000:0.0:1788839662.014603:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839662.014824:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139264 00000100:00100000:3.0:1788839662.014847:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139264 00000100:00100000:3.0:1788839662.014898:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 344 00000100:00100000:3.0:1788839662.014907:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050139264:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.015056:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050139264:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 149us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839662.015071:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 344 00000100:00100000:1.0:1788839662.021913:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839662.022018:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139392 00000100:00100000:2.0:1788839662.022028:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139392 00000100:00100000:2.0:1788839662.022093:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:2.0:1788839662.022103:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:10794:x1875734050139392:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839662.022249:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+12:10794:x1875734050139392:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 147us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839662.022258:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:1.0:1788839662.034692:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839662.035328:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139520 00000100:00100000:0.0:1788839662.035338:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139520 00000100:00100000:0.0:1788839662.035400:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 346 00000100:00100000:0.0:1788839662.035410:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:10794:x1875734050139520:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788839662.035557:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+12:10794:x1875734050139520:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 148us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.035565:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 346 00000100:00100000:0.0:1788839662.044342:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839662.044612:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139648 00000100:00100000:3.0:1788839662.044621:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139648 00000100:00100000:3.0:1788839662.044675:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 347 00000100:00100000:3.0:1788839662.044683:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+12:6165:x1875734050139648:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839662.044699:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839662.044715:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572dd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74808 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.044740:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74808 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.044751:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572dd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74808 expref: 13 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.044760:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6c00, rc 0) 00000100:00100000:3.0:1788839662.044830:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050139648:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 148us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839662.044837:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 347 00000100:00100000:1.0:1788839662.049181:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839662.049284:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139776 00000100:00100000:2.0:1788839662.049295:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139776 00000100:00100000:2.0:1788839662.049351:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 348 00000100:00100000:2.0:1788839662.049361:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050139776:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839662.049514:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050139776:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 153us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839662.049522:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 348 00000100:00100000:1.0:1788839662.056557:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839662.056795:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050139904 00000100:00100000:0.0:1788839662.056805:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050139904 00000100:00100000:0.0:1788839662.056855:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 349 00000100:00100000:0.0:1788839662.056864:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050139904:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839662.057012:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:6165:x1875734050139904:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 148us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.057019:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 349 00000100:00100000:0.0:1788839662.062321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839662.062411:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140032 00000100:00100000:3.0:1788839662.062422:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140032 00000100:00100000:3.0:1788839662.062476:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 350 00000100:00100000:3.0:1788839662.062487:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:10797:x1875734050140032:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839662.062806:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:10797:x1875734050140032:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 320us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839662.062814:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 350 00000100:00100000:1.0:1788839662.066251:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839662.066338:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140160 00000100:00100000:2.0:1788839662.066347:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140160 00000100:00100000:2.0:1788839662.066401:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 351 00000100:00100000:2.0:1788839662.066411:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:10797:x1875734050140160:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839662.066567:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:10797:x1875734050140160:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 157us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839662.066575:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 351 10000000:01000000:2.0:1788839662.143056:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839662.143073:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab646536000 from 7 10000000:01000000:2.0:1788839662.143077:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839662.143125:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839662.143138:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839662.143148:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839662.143185:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060710656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839662.143251:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839662.143370:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710656 00000100:00100000:0.0:1788839662.143379:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710656 00000100:00100000:0.0:1788839662.143438:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788839662.143448:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+20:6483:x1875734060710656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839662.143460:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839662.143471:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfdc00/0xad5b343a26572dde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572dd7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839662.143493:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfdc00/0xad5b343a26572dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572dd7 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839662.143503:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfdc00/0xad5b343a26572dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572dd7 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839662.143511:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfdc00, rc 0) 00000100:00100000:0.0:1788839662.143552:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060710656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.143558:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788839662.143808:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839662.143828:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060710656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839662.143844:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839662.143852:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839662.143907:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060710784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839662.143940:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839662.144008:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710784 00000100:00100000:3.0:1788839662.144012:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710784 00000100:00100000:3.0:1788839662.144040:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788839662.144046:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060710784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.144160:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775072450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060710784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839662.144166:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788839662.148531:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419b7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839662.148585:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060710784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839662.148900:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060710912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839662.149123:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839662.149218:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419b7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839662.151908:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060710912 00000100:00100000:3.0:1788839662.151923:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060710912 00000100:00100000:2.0:1788839662.153234:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788839662.153252:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060710912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839662.153435:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060710912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (4377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839662.153443:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788839662.153561:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060710912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.154305:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13761:1875734060711040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839662.154357:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839662.158967:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647873180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839662.160362:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711040 00000100:00100000:0.0:1788839662.160374:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711040 00000100:00100000:0.0:1788839662.160453:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788839662.160463:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:13761:x1875734060711040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839662.163315:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+21:13761:x1875734060711040:12345-0@lo:502:llog_process_th.0 Request processed in 2844us (8948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.163331:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788839662.168901:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13761:1875734060711040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839662.169017:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839662.169030:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839662.169033:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788839662.169039:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab646536000 00000020:00000080:3.0:1788839662.169042:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788839662.169213:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839662.169217:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839662.169218:0:13761:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788839662.169221:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839662.169233:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839662.169235:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788839662.169239:0:13761:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab646536000 00000020:00000080:3.0:1788839662.169241:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788839662.182822:0:13761:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13761:1875734060711168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839662.182917:0:13761:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839662.183055:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711168 00000100:00100000:2.0:1788839662.183074:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711168 00000100:00100000:2.0:1788839662.183134:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788839662.183144:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:13761:x1875734060711168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839662.196924:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+21:13761:x1875734060711168:12345-0@lo:502:llog_process_th.0 Request processed in 13773us (13997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839662.196962:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788839662.197792:0:13761:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647873180 going to sleep for 11 seconds 00000100:00100000:3.0:1788839662.197823:0:13761:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13761:1875734060711168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839662.197855:0:13761:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839662.197862:0:13761:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839662.197865:0:13761:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788839662.197869:0:13761:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788839662.198150:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788839662.198173:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839662.198184:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.198207:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839662.198217:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839662.198219:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab777b41000 from 7 10000000:01000000:1.0:1788839662.198222:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839662.198252:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.198260:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.198269:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839662.198289:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.198336:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.198357:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839662.198799:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711296 00000100:00100000:2.0:1788839662.198807:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711296 00000100:00100000:2.0:1788839662.198850:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788839662.198858:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+21:6483:x1875734060711296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839662.198869:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839662.198881:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab7413ca600/0xad5b343a26572dec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572de5 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839662.198903:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab7413ca600/0xad5b343a26572dec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572de5 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839662.198914:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab7413ca600/0xad5b343a26572dec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572de5 expref: 22 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839662.198922:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413ca600, rc 0) 00000100:00100000:2.0:1788839662.198983:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060711296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839662.198990:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788839662.199092:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839662.199106:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.199114:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839662.199166:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.199198:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.199222:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.199235:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711424 00000100:00100000:1.0:1788839662.199238:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711424 00000100:00100000:1.0:1788839662.199256:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788839662.199261:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060711424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.199359:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775071c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060711424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.199366:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788839662.199388:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.199409:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.199441:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.199451:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.199460:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711552 00000100:00100000:1.0:1788839662.199462:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711552 00000100:00100000:1.0:1788839662.199475:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788839662.199480:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060711552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.199550:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060711552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.199556:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788839662.199586:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.199765:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13763:1875734060711680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839662.199807:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.199822:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711680 00000100:00100000:1.0:1788839662.199825:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711680 00000100:00100000:1.0:1788839662.199838:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788839662.199842:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:13763:x1875734060711680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839662.199899:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:13763:x1875734060711680:12345-0@lo:502:llog_process_th.0 Request processed in 56us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.199905:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788839662.199926:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.199936:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13763:1875734060711680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839662.199965:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839662.199977:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.199979:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839662.199985:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab777b41000 00000020:00000080:1.0:1788839662.199988:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839662.200040:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839662.200043:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.200045:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839662.200047:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839662.200050:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.200051:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788839662.200055:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab777b41000 00000020:00000080:1.0:1788839662.200056:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788839662.200085:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13763:1875734060711808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839662.200114:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.200131:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711808 00000100:00100000:1.0:1788839662.200135:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711808 00000100:00100000:1.0:1788839662.200150:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788839662.200155:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:13763:x1875734060711808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839662.200224:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:13763:x1875734060711808:12345-0@lo:502:llog_process_th.0 Request processed in 68us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.200230:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788839662.200262:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.200273:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13763:1875734060711808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839662.200290:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839662.200294:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.200295:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788839662.200299:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788839662.200343:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788839662.200358:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839662.200365:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200375:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839662.200384:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839662.200386:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab74434b000 from 7 10000000:01000000:1.0:1788839662.200389:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839662.200408:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200415:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200424:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839662.200436:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.200461:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.200473:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.200484:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060711936 00000100:00100000:1.0:1788839662.200493:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060711936 00000100:00100000:1.0:1788839662.200511:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788839662.200517:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+22:6483:x1875734060711936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839662.200524:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839662.200534:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647958800/0xad5b343a26572dfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572df3 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200550:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958800/0xad5b343a26572dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572df3 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200560:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647958800/0xad5b343a26572dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572df3 expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200567:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958800, rc 0) 00000100:00100000:1.0:1788839662.200594:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060711936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.200600:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788839662.200621:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060711936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839662.200631:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839662.200638:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839662.200671:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.200690:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.200701:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.200709:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712064 00000100:00100000:1.0:1788839662.200716:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712064 00000100:00100000:1.0:1788839662.200730:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788839662.200735:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060712064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.200816:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060712064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.200822:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788839662.200846:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.200865:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.200894:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.200906:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.200916:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712192 00000100:00100000:1.0:1788839662.200919:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712192 00000100:00100000:1.0:1788839662.200935:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788839662.200953:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060712192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839662.201011:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060712192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.201016:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788839662.201046:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839662.208571:0:13764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13764:1875734060712320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839662.208676:0:13764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839662.208725:0:13764:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7506a76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839662.208919:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712320 00000100:00100000:1.0:1788839662.208931:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712320 00000100:00100000:1.0:1788839662.209012:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788839662.209023:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:13764:x1875734060712320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839662.209139:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+23:13764:x1875734060712320:12345-0@lo:502:llog_process_th.0 Request processed in 118us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839662.209147:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788839662.209364:0:13764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13764:1875734060712320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839662.209393:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839662.209403:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839662.209405:0:13764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839662.209413:0:13764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab74434b000 00000020:00000080:0.0:1788839662.209416:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839662.209480:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839662.209484:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839662.209485:0:13764:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839662.209488:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839662.209490:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839662.209491:0:13764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788839662.209494:0:13764:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab74434b000 00000020:00000080:0.0:1788839662.209497:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788839662.209532:0:13764:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13764:1875734060712448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839662.209569:0:13764:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839662.209598:0:13764:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7506a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839662.209640:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712448 00000100:00100000:3.0:1788839662.209645:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712448 00000100:00100000:3.0:1788839662.209693:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788839662.209700:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:13764:x1875734060712448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839662.209815:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+23:13764:x1875734060712448:12345-0@lo:502:llog_process_th.0 Request processed in 115us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839662.209823:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788839662.210073:0:13764:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13764:1875734060712448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788839662.210094:0:13764:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839662.210103:0:13764:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839662.210105:0:13764:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788839662.210109:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788839662.210265:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788839662.210287:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839662.210296:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.210308:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839662.210318:0:6483:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788839662.210326:0:6483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab745341000 from 7 10000000:01000000:3.0:1788839662.210329:0:6483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839662.210353:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.210361:0:6483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.210369:0:6483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839662.210384:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.210414:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839662.210441:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839662.210478:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712576 00000100:00100000:0.0:1788839662.210483:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712576 00000100:00100000:0.0:1788839662.210516:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788839662.210524:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+23:6483:x1875734060712576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839662.210533:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839662.210544:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfd600/0xad5b343a26572e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26572e01 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839662.210564:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfd600/0xad5b343a26572e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26572e01 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839662.210574:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfd600/0xad5b343a26572e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26572e01 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839662.210583:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd600, rc 0) 00000100:00100000:0.0:1788839662.210609:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060712576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.210616:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788839662.210678:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839662.210690:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.210699:0:6483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839662.210745:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.210808:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839662.210829:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839662.211049:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712704 00000100:00100000:0.0:1788839662.211054:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712704 00000100:00100000:0.0:1788839662.211084:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788839662.211091:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060712704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839662.211190:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060712704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.211197:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788839662.212053:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.212272:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788839662.212322:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839662.212392:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839662.214426:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712832 00000100:00100000:0.0:1788839662.214447:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712832 00000100:00100000:0.0:1788839662.214509:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788839662.214519:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060712832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839662.214666:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:6483:x1875734060712832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (2342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.214674:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788839662.215192:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:096dcd45-3d06-4359-b81b-4bde04036a06:6483:1875734060712832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839662.215510:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13766:1875734060712960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839662.215559:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839662.215624:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e59c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839662.215904:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060712960 00000100:00100000:3.0:1788839662.215911:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060712960 00000100:00100000:3.0:1788839662.216067:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788839662.216076:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:13766:x1875734060712960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839662.216179:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:13766:x1875734060712960:12345-0@lo:502:llog_process_th.0 Request processed in 104us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839662.216186:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788839662.216260:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13766:1875734060712960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839662.216286:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839662.216306:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.216308:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839662.216317:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab745341000 00000020:00000080:1.0:1788839662.216320:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839662.216367:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839662.216370:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.216372:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839662.216374:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839662.216377:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.216378:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788839662.216381:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab745341000 00000020:00000080:1.0:1788839662.216383:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788839662.216415:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13766:1875734060713088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839662.216450:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839662.216682:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839662.218649:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713088 00000100:00100000:0.0:1788839662.218662:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713088 00000100:00100000:0.0:1788839662.218705:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788839662.218714:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:13766:x1875734060713088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839662.218887:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:13766:x1875734060713088:12345-0@lo:502:llog_process_th.0 Request processed in 172us (2434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.218894:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000040:00080000:2.0:1788839662.219212:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788839662.219377:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:096dcd45-3d06-4359-b81b-4bde04036a06:13766:1875734060713088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839662.219410:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839662.219417:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839662.219419:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788839662.219424:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788839662.219683:0:6483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788839662.219706:0:6483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839662.219717:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839662.219728:0:6483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839662.237337:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839662.399221:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839662.977609:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839662.977638:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060713216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839662.977716:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839662.977895:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713216 00000100:00100000:0.0:1788839662.977906:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713216 00000100:00100000:0.0:1788839662.977975:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788839662.977986:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060713216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839662.978031:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839662.978076:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060713216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839662.978093:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788839662.978440:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060713216:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788839663.231743:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788839663.295646:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839663.423180:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839664.448184:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839665.477972:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839665.535542:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060713344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839665.535629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.535695:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839665.535702:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060713472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839665.535722:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839665.537215:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713344 00000100:00100000:2.0:1788839665.537227:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713344 00000100:00100000:2.0:1788839665.537284:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713472 00000100:00100000:2.0:1788839665.537288:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713472 00000100:00100000:2.0:1788839665.537320:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839665.537333:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060713344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839665.537365:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839665.537431:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060713344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839665.537438:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839665.537454:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839665.537460:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060713472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839665.537476:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839665.537501:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060713472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839665.537506:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788839665.538183:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839665.538204:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839665.538327:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060713728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839665.538374:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.538411:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060714240:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.538435:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060713600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839665.538436:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.538452:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060714752:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.538461:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.538472:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839665.538479:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060714112:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.538498:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.538505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060713856:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.538512:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060714624:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.538528:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.538528:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.538542:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060714368:0@lo:400:kworker.0 00000100:00100000:1.0:1788839665.538563:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839665.538620:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713728 00000100:00100000:3.0:1788839665.538626:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713728 00000100:00100000:3.0:1788839665.538660:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788839665.538667:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060713728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.538712:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060713728:12345-0@lo:400:kworker.0 Request processed in 45us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.538719:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788839665.538751:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060713984:0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.538808:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839665.538826:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060714496:0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.538846:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839665.539037:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060714880:0@lo:400:kworker.0 00000100:00100000:0.0:1788839665.541484:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714624 00000100:00100000:0.0:1788839665.541501:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714624 00000100:00100000:0.0:1788839665.541658:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788839665.541682:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060714624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839665.541788:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060714624:12345-0@lo:400:kworker.0 Request processed in 109us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839665.541795:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1788839665.541914:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6480f7480 x1875734060714624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839665.541937:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060714624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839665.542000:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060715136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839665.542035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839665.542069:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713600 00000100:00100000:0.0:1788839665.542073:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713600 00000100:00100000:0.0:1788839665.542093:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715136 00000100:00100000:0.0:1788839665.542095:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715136 00000100:00100000:0.0:1788839665.542110:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788839665.542620:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060713600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839665.542642:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839665.542689:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060713600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 573us (4226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839665.542696:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788839665.542712:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839665.542719:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060715136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839665.542728:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839665.544876:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714752 00000100:00100000:3.0:1788839665.544889:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060715008:0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.544957:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839665.544967:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714752 00000100:00100000:2.0:1788839665.545015:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714112 00000100:00100000:2.0:1788839665.545020:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714112 00000100:00100000:3.0:1788839665.545022:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715008 00000100:00100000:3.0:1788839665.545028:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715008 00000100:00100000:3.0:1788839665.545058:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788839665.545066:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060715008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545115:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060715008:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545122:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788839665.545155:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714240 00000100:00100000:3.0:1788839665.545159:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714240 00000100:00100000:3.0:1788839665.545177:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713984 00000100:00100000:3.0:1788839665.545180:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713984 00000100:00100000:3.0:1788839665.545193:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788839665.545199:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060714240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545234:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060714240:12345-0@lo:400:kworker.0 Request processed in 35us (6797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545241:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788839665.545252:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788839665.545257:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060713984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545285:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060713984:12345-0@lo:400:kworker.0 Request processed in 28us (6477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545291:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788839665.545353:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060713728:0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545368:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060714240:0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839665.545433:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060713472:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788839665.545448:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a33800 x1875734060713344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839665.545460:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060713344:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839665.545490:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060713984:0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545500:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060715008:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.545525:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060713856 00000100:00100000:2.0:1788839665.545530:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060713856 00000100:00100000:3.0:1788839665.545535:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714368 00000100:00100000:3.0:1788839665.545541:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714368 00000100:00100000:2.0:1788839665.545547:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714496 00000100:00100000:2.0:1788839665.545551:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714496 00000100:00100000:3.0:1788839665.545569:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060714880 00000100:00100000:2.0:1788839665.545574:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788839665.545581:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060714752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545585:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060714880 00000100:00100000:3.0:1788839665.545612:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788839665.545620:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060714112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.545631:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060714752:12345-0@lo:400:kworker.0 Request processed in 49us (7156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839665.545637:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788839665.545653:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788839665.545659:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060713856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545665:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060714112:12345-0@lo:400:kworker.0 Request processed in 44us (7163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545673:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788839665.545692:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788839665.545699:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060713856:12345-0@lo:400:kworker.0 Request processed in 39us (7169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545702:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060714368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.545710:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788839665.545724:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788839665.545731:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060714496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545744:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060714368:12345-0@lo:400:kworker.0 Request processed in 45us (7178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545750:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788839665.545796:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788839665.545812:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060714880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839665.545842:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060714880:12345-0@lo:400:kworker.0 Request processed in 33us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839665.545847:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788839665.545865:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060714496:12345-0@lo:400:kworker.0 Request processed in 38us (6921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839665.545873:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788839665.545905:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060714752:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.546330:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060713856:0@lo:400:kworker.0 00000100:00100000:2.0:1788839665.546343:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060714368:0@lo:400:kworker.0 00010000:00080000:2.0:1788839665.546355:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6480f5c00 x1875734060714880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839665.546381:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060714880:0@lo:400:kworker.0 00000100:00100000:0.0:1788839665.546419:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060715136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3699us (4382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839665.546427:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788839665.546535:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060715136:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788839665.546617:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a31880 x1875734060713600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839681 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839665.546631:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060713600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839665.546643:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060714112:0@lo:400:kworker.0 00000100:00080000:0.0:1788839665.546753:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839665.546758:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839665.546761:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839665.546763:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788839665.548190:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6480f6680 x1875734060714496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839681 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839665.548207:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060714496:0@lo:400:kworker.0 00000100:00100000:2.0:1788839666.048098:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839666.048346:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060715264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839666.048414:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839666.048530:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715264 00000100:00100000:3.0:1788839666.048538:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715264 00000100:00100000:3.0:1788839666.048584:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788839666.048592:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060715264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839666.048625:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788839666.048688:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060715264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839666.048694:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788839666.048809:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060715264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839666.351945:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839666.351987:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839666.352033:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839666.352119:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839666.352144:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839666.352233:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140672 00000100:00100000:0.0:1788839666.352242:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140672 00000100:00100000:0.0:1788839666.352301:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1788839666.352311:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050140672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839666.352375:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050140672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 66us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839666.352381:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00080000:0.0:1788839666.352403:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839666.352426:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140288 00000100:00100000:0.0:1788839666.352430:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140288 00000100:00100000:0.0:1788839666.352450:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 373 00000100:00100000:0.0:1788839666.352457:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050140288:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839666.352482:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050140288:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839666.352489:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 373 00000100:00100000:1.0:1788839666.356989:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839666.357166:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140416 00000100:00100000:2.0:1788839666.357177:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140416 00000100:00100000:2.0:1788839666.357236:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140928 00000100:00100000:2.0:1788839666.357239:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140928 00000100:00100000:2.0:1788839666.357258:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140544 00000100:00100000:2.0:1788839666.357261:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140544 00000100:00100000:2.0:1788839666.357280:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:2.0:1788839666.357289:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050140416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839666.357359:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050140416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 71us (5423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839666.357366:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:2.0:1788839666.357383:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:2.0:1788839666.357389:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050140928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839666.357412:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050140928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (5379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839666.357417:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:2.0:1788839666.357427:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:2.0:1788839666.357432:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050140544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839666.357487:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050140544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 55us (5342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839666.357500:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00080000:2.0:1788839666.357521:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839666.357524:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839666.359199:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050140800 00000100:00100000:2.0:1788839666.359211:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050140800 00000100:00100000:2.0:1788839666.359278:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:2.0:1788839666.359287:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050140800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839666.359357:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050140800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839666.359364:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00080000:1.0:1788839666.359474:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839666.495127:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788839667.079253:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788839667.519739:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839668.096377:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060715392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839668.096450:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839668.096512:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715392 00000100:00100000:3.0:1788839668.096521:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715392 00000100:00100000:3.0:1788839668.096568:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788839668.096577:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060715392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839668.096614:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839668.096670:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060715392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839668.096676:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788839668.096840:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060715392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839668.542997:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839669.568857:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839670.593044:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839670.655210:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060715520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839670.655284:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839670.655478:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715520 00000100:00100000:3.0:1788839670.655488:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715520 00000100:00100000:3.0:1788839670.655559:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788839670.655570:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060715520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839670.655634:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839670.655686:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060715520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 117us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839670.655694:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788839670.655758:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060715776:0@lo:400:kworker.0 00000100:00100000:3.0:1788839670.655816:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839670.655842:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060716288:0@lo:400:kworker.0 00000100:00100000:3.0:1788839670.655877:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839670.655927:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060715648:0@lo:400:kworker.0 00000100:00100000:2.0:1788839670.655965:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839670.655993:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060716160:0@lo:400:kworker.0 00000100:00100000:2.0:1788839670.656017:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839670.656034:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060716672:0@lo:400:kworker.0 00000100:00080000:1.0:1788839670.656164:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839670.656192:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060716032:0@lo:400:kworker.0 00000100:00100000:2.0:1788839670.659479:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715776 00000100:00100000:1.0:1788839670.659491:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716288 00000100:00100000:2.0:1788839670.659496:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715776 00000100:00100000:1.0:1788839670.659498:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716288 00000100:00100000:2.0:1788839670.659567:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788839670.659579:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788839670.659581:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060715776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.659591:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060716288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839670.660846:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716160 00000100:00100000:0.0:1788839670.660857:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716160 00000100:00100000:0.0:1788839670.660914:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788839670.660922:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060716160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.662528:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060716288:12345-0@lo:400:kworker.0 Request processed in 2934us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.662538:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788839670.662589:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060715904:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.662629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.662650:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060716416:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.662672:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.662698:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060716928:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.662720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.662756:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716928 00000100:00100000:1.0:1788839670.662763:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716928 00000100:00100000:1.0:1788839670.662856:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788839670.662864:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060716928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.663012:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060716928:12345-0@lo:400:kworker.0 Request processed in 148us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.663019:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788839670.663040:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839670.663045:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839670.663071:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060716928:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.663169:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.664155:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060716544:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.664264:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.664289:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060717056:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.664327:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788839670.664373:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443d9c00 x1875734060715520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839670.664394:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060715520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839670.664433:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716544 00000100:00100000:1.0:1788839670.664438:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716544 00000100:00100000:1.0:1788839670.664541:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717056 00000100:00100000:1.0:1788839670.664545:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717056 00000100:00100000:1.0:1788839670.664571:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839670.664578:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060716544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.664632:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060716544:12345-0@lo:400:kworker.0 Request processed in 54us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.664638:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788839670.664652:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788839670.664657:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060717056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.664685:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060717056:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.664690:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788839670.664716:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839670.664720:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839670.664732:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716416 00000100:00100000:1.0:1788839670.664735:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716416 00000100:00100000:1.0:1788839670.664842:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716032 00000100:00100000:1.0:1788839670.664847:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716032 00000100:00100000:1.0:1788839670.664860:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788839670.664865:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060716416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.664980:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060716416:12345-0@lo:400:kworker.0 Request processed in 114us (2306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.664994:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788839670.665007:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788839670.665013:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060716032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.665044:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060716032:12345-0@lo:400:kworker.0 Request processed in 31us (1874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.665050:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1788839670.665064:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788839670.665159:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e41880 x1875734060716416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839670.665170:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060716416:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.665448:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060716032:0@lo:400:kworker.0 00010000:00080000:1.0:1788839670.665460:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e43b80 x1875734060716544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839670.665469:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060716544:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.665478:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788839670.665484:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab64783e300, transno 4294967301 00000100:00100000:1.0:1788839670.665496:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060717056:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.665677:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060717440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839670.665709:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.666449:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.666486:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060717184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839670.666519:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.666545:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839670.666563:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060717312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839670.666588:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839670.666615:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716672 00000100:00100000:1.0:1788839670.666620:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716672 00000100:00100000:1.0:1788839670.666660:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788839670.666668:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060716672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.666713:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060716672:12345-0@lo:400:kworker.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.666720:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1788839670.666739:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839670.666791:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060716672:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.666821:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717440 00000100:00100000:1.0:1788839670.666825:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717440 00000100:00100000:1.0:1788839670.666842:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717184 00000100:00100000:1.0:1788839670.666844:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717184 00000100:00100000:1.0:1788839670.666856:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717312 00000100:00100000:1.0:1788839670.666857:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717312 00000100:00100000:1.0:1788839670.666878:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839670.666894:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060717440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839670.666910:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839670.666946:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060717440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.666952:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788839670.666963:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788839670.666969:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060717184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788839670.666984:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839670.667013:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060717184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.667026:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788839670.667038:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788839670.667044:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060717312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839670.667053:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839670.667077:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060717312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.667092:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1788839670.667119:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777cad180 x1875734060717440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839686 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839670.667135:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060717440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839670.667162:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060717312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839670.667174:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060717184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839670.667337:0:6493:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788839670.667346:0:6493:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788839670.667367:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715648 00000100:00100000:1.0:1788839670.667371:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715648 00000100:00100000:1.0:1788839670.667400:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788839670.667407:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060715648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.667445:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060715648:12345-0@lo:400:kworker.0 Request processed in 39us (11479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.667450:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1788839670.667555:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060715648:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.667586:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060715904 00000100:00100000:1.0:1788839670.667590:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060715904 00000100:00100000:1.0:1788839670.667689:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839670.667696:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060715904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.667735:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060715904:12345-0@lo:400:kworker.0 Request processed in 41us (5106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.667748:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839670.667806:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060715904:0@lo:400:kworker.0 00000100:00100000:2.0:1788839670.670051:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060715776:12345-0@lo:400:kworker.0 Request processed in 10456us (14217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839670.670232:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788839670.670760:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060716160:12345-0@lo:400:kworker.0 Request processed in 9836us (14739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839670.670802:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788839670.672153:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060716160:0@lo:400:kworker.0 00000100:00100000:3.0:1788839670.678187:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060716288:0@lo:400:kworker.0 00000100:00100000:3.0:1788839670.678205:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060716800:0@lo:400:kworker.0 00000100:00100000:3.0:1788839670.678270:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839670.678351:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060715776:0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.681023:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060716800 00000100:00100000:1.0:1788839670.681039:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060716800 00000100:00100000:1.0:1788839670.683315:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788839670.683328:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060716800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839670.683435:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060716800:12345-0@lo:400:kworker.0 Request processed in 110us (5165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839670.683443:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1788839670.683507:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788839670.683669:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e42a00 x1875734060716800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839686 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839670.683683:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060716800:0@lo:400:kworker.0 00000100:00100000:2.0:1788839671.167108:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839671.167132:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060717568:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839671.167214:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839671.167389:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717568 00000100:00100000:1.0:1788839671.167397:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717568 00000100:00100000:1.0:1788839671.167595:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788839671.167605:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060717568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839671.167638:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839671.167698:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060717568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839671.167706:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788839671.167823:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060717568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839671.470605:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839671.470652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839671.470793:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141184 00000100:00100000:3.0:1788839671.470803:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141184 00000100:00100000:0.0:1788839671.470925:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141056 00000100:00100000:0.0:1788839671.470931:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141056 00000100:00080000:2.0:1788839671.470964:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839671.470975:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 375 00000100:00100000:0.0:1788839671.470985:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050141056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839671.471006:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:3.0:1788839671.471017:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050141184:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839671.471117:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75ff4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050141056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 132us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839671.471125:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 375 00000100:00100000:3.0:1788839671.474810:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050141184:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 3782us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839671.474845:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:1.0:1788839671.474930:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839671.474969:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839671.475009:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839671.475034:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839671.475054:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141696 00000100:00100000:1.0:1788839671.475061:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141696 00000100:00100000:1.0:1788839671.475107:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141312 00000100:00100000:1.0:1788839671.475111:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141312 00000100:00100000:1.0:1788839671.475127:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141568 00000100:00100000:1.0:1788839671.479035:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141568 00000100:00100000:1.0:1788839671.479123:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:1.0:1788839671.479147:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050141696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839671.479227:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050141696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 94us (4256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839671.479234:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:1.0:1788839671.479254:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:1.0:1788839671.479260:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050141312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839671.479285:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050141312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (4275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839671.479292:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:1.0:1788839671.479305:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:1.0:1788839671.479312:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050141568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839671.479336:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050141568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (4301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839671.479342:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00080000:1.0:1788839671.479390:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839671.479394:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839671.479762:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141440 00000100:00100000:3.0:1788839671.479796:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141440 00000100:00100000:3.0:1788839671.479851:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1788839671.479859:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050141440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839671.479902:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050141440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839671.479908:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00080000:1.0:1788839671.480010:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788839671.615000:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839672.639693:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839673.215759:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839673.215817:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060717696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839673.215904:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839673.215965:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717696 00000100:00100000:0.0:1788839673.215975:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717696 00000100:00100000:0.0:1788839673.216029:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788839673.216040:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060717696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839673.216075:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839673.216133:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060717696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839673.216140:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788839673.216186:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060717696:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788839673.472811:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788839673.535518:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839673.664317:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839674.687072:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839675.710978:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839675.775708:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839675.775732:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060717824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839675.775812:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.775894:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717824 00000100:00100000:1.0:1788839675.775901:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717824 00000100:00100000:1.0:1788839675.775963:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788839675.775973:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060717824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839675.776035:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839675.776314:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060717824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 341us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839675.776321:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788839675.776342:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839675.776379:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060717824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839675.776536:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060717952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839675.776699:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.776729:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839675.776736:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060718080:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.776762:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839675.777052:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718080 00000100:00100000:2.0:1788839675.777060:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718080 00000100:00100000:2.0:1788839675.777095:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788839675.777102:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060718080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839675.777144:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab762cd2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060718080:12345-0@lo:400:kworker.0 Request processed in 42us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839675.777150:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788839675.777175:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839675.777184:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060718208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839675.777207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839675.777247:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060717952 00000100:00100000:2.0:1788839675.777289:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060717952 00000100:00100000:2.0:1788839675.777314:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718208 00000100:00100000:2.0:1788839675.777317:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718208 00000100:00100000:2.0:1788839675.777330:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788839675.777336:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060717952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839675.777348:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839675.777374:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060717952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839675.777390:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788839675.777401:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788839675.777407:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060718208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839675.777423:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839675.777453:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060718208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839675.777467:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:2.0:1788839675.777795:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e42d80 x1875734060718208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839675.777813:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060718208:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788839675.778502:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839675.778509:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839675.778653:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060718080:0@lo:400:kworker.0 00000100:00100000:2.0:1788839675.778743:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060717952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839675.778927:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839675.779200:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060718336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839675.779364:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839675.779404:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718336 00000100:00100000:3.0:1788839675.779410:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718336 00000100:00100000:3.0:1788839675.779461:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788839675.779469:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060718336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839675.779487:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839675.779523:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060718336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839675.779540:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788839675.779718:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788839675.779737:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443d9c00 x1875734060718336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839691 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839675.779751:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060718336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839675.781057:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060718592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.781119:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.781161:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060719104:0@lo:400:kworker.0 00000100:00100000:0.0:1788839675.781188:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060718720:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.781191:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.781214:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788839675.781223:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060718464:0@lo:400:kworker.0 00000100:00100000:0.0:1788839675.781234:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839675.781258:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060719232:0@lo:400:kworker.0 00000100:00100000:0.0:1788839675.781278:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839675.781295:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788839675.781301:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060718848:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.781448:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.781471:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060718976:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.781500:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.781528:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719104 00000100:00100000:1.0:1788839675.781534:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719104 00000100:00100000:1.0:1788839675.781573:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718720 00000100:00100000:1.0:1788839675.781576:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718720 00000100:00100000:1.0:1788839675.781588:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719232 00000100:00100000:1.0:1788839675.781590:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719232 00000100:00100000:1.0:1788839675.781706:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718464 00000100:00100000:1.0:1788839675.781710:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718464 00000100:00100000:1.0:1788839675.781725:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718976 00000100:00100000:1.0:1788839675.781727:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718976 00000100:00100000:1.0:1788839675.781743:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788839675.781751:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060719104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.781819:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060719104:12345-0@lo:400:kworker.0 Request processed in 68us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839675.781826:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788839675.781842:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788839675.781848:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060718720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.781886:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060718720:12345-0@lo:400:kworker.0 Request processed in 38us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839675.781893:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788839675.781903:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788839675.781909:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060719232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.782001:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060719232:12345-0@lo:400:kworker.0 Request processed in 25us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839675.782009:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788839675.782022:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788839675.782027:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060718464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.782123:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060718464:12345-0@lo:400:kworker.0 Request processed in 95us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839675.782129:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788839675.782141:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788839675.782146:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060718976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.782170:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060718976:12345-0@lo:400:kworker.0 Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839675.782175:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788839675.782219:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060718464:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.782308:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060718976:0@lo:400:kworker.0 00010000:00080000:1.0:1788839675.782321:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab64783ca80 x1875734060719104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839675.782330:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060719104:0@lo:400:kworker.0 00000100:00080000:1.0:1788839675.782357:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839675.782362:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839675.783158:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718592 00000100:00100000:2.0:1788839675.783166:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718592 00000100:00100000:1.0:1788839675.783177:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.783268:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060719360:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.783298:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839675.783339:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060718720:0@lo:400:kworker.0 00000100:00100000:1.0:1788839675.783351:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060719232:0@lo:400:kworker.0 00000100:00100000:3.0:1788839675.783635:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719360 00000100:00100000:3.0:1788839675.783639:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719360 00000100:00100000:3.0:1788839675.783687:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788839675.783696:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060719360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839675.783740:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060719360:12345-0@lo:400:kworker.0 Request processed in 46us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839675.783747:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00010000:00080000:3.0:1788839675.783793:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab64783dc00 x1875734060719360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839691 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839675.783804:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060719360:0@lo:400:kworker.0 00000100:00080000:1.0:1788839675.783946:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839675.785266:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060718848 00000100:00100000:0.0:1788839675.785279:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060718848 00000100:00100000:0.0:1788839675.785320:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788839675.785329:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060718592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839675.785405:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060718592:12345-0@lo:400:kworker.0 Request processed in 77us (4288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839675.785412:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788839675.785429:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788839675.785435:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060718848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839675.785484:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060718848:12345-0@lo:400:kworker.0 Request processed in 50us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839675.785490:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788839675.785527:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060718848:0@lo:400:kworker.0 00000100:00100000:3.0:1788839675.786076:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060718592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839676.287012:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060719488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839676.287087:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839676.287248:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719488 00000100:00100000:2.0:1788839676.287257:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719488 00000100:00100000:2.0:1788839676.287315:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788839676.287325:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060719488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839676.287355:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788839676.290650:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060719488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3317us (3553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839676.290664:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788839676.291400:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060719488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839676.586169:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839676.586210:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839676.586241:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839676.586272:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142080 00000100:00100000:1.0:1788839676.586282:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142080 00000100:00100000:1.0:1788839676.586334:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141952 00000100:00100000:1.0:1788839676.586337:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141952 00000100:00100000:1.0:1788839676.586357:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 259 00000100:00100000:1.0:1788839676.586366:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050142080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839676.586433:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050142080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839676.586440:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 259 00000100:00100000:1.0:1788839676.586468:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 260 00000100:00100000:1.0:1788839676.586475:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050141952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839676.586498:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050141952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839676.586504:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 260 00000100:00080000:1.0:1788839676.586608:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839676.586615:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839676.586683:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050141824 00000100:00100000:0.0:1788839676.586688:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050141824 00000100:00100000:0.0:1788839676.586724:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 377 00000100:00100000:0.0:1788839676.586731:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050141824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839676.586762:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7508d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050141824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839676.586801:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 377 00000100:00100000:1.0:1788839676.604095:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839676.604133:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839676.604296:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839676.606327:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142208 00000100:00100000:0.0:1788839676.606342:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142208 00000100:00100000:0.0:1788839676.606435:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1788839676.606467:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2388:x1875734050142208:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1788839676.606503:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572d2f 00000100:00080000:0.0:1788839676.606511:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab777c26800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839676.606563:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1788839676.606579:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788839676.606621:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839676.607297:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+2:2388:x1875734050142208:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 850us (2997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839676.607306:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788839676.607430:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142336 00000100:00100000:3.0:1788839676.607437:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142336 00000100:00100000:3.0:1788839676.607488:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142464 00000100:00100000:3.0:1788839676.607492:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142464 00000100:00100000:1.0:1788839676.607504:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 261 00000100:00100000:1.0:1788839676.607516:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050142336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839676.607576:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050142336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 64us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839676.607744:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 261 00000100:00100000:1.0:1788839676.607762:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 262 00000100:00100000:1.0:1788839676.607787:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050142464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839676.607817:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050142464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839676.607875:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 262 00000100:00080000:0.0:1788839676.608306:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839676.608311:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839676.736645:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839677.759013:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839678.336204:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060719616:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839678.336279:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839678.336459:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719616 00000100:00100000:2.0:1788839678.336466:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719616 00000100:00100000:2.0:1788839678.338661:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788839678.338672:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060719616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839678.338708:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839678.338811:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060719616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (2536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839678.338818:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788839678.338925:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060719616:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839678.783458:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839679.807063:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839680.831911:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839680.895048:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839680.895072:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060719744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839680.895104:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839680.895113:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060720000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839680.895141:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839680.895235:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060719872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839680.895291:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839680.895495:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719744 00000100:00100000:2.0:1788839680.895504:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719744 00000100:00100000:2.0:1788839680.895562:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060719872 00000100:00100000:2.0:1788839680.895566:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060719872 00000100:00100000:2.0:1788839680.895584:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788839680.895592:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060719744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839680.895619:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839680.895660:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060719744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839680.895667:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788839680.895682:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788839680.895687:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060719872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839680.895700:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839680.895722:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060719872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839680.895728:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788839680.896181:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839680.896264:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720000 00000100:00100000:2.0:1788839680.896269:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720000 00000100:00100000:2.0:1788839680.896290:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788839680.896309:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060720000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839680.896331:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839680.896374:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060720000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839680.896380:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:0.0:1788839680.896463:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab64783df80 x1875734060720000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839680.896482:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060720000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839680.897249:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060720256:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.897307:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839680.897335:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060720768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.897359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839680.897374:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060721280:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.897397:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839680.897426:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788839680.897442:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060720128:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.897477:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839680.897499:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060720640:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.897522:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839680.897609:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839680.897614:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839680.897628:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060720512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839680.897658:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839680.897676:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060721024:0@lo:400:kworker.0 00000100:00100000:3.0:1788839680.897696:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788839680.897726:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647a30380 x1875734060719744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839696 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839680.897743:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060719744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839680.897760:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060719872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839680.897797:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788839680.897825:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060720384:0@lo:400:kworker.0 00000100:00100000:3.0:1788839680.897867:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720640 00000100:00100000:0.0:1788839680.897867:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060721152:0@lo:400:kworker.0 00000100:00100000:3.0:1788839680.897871:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720640 00000100:00100000:0.0:1788839680.897890:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839680.897904:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788839680.897912:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060720640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.897916:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720256 00000100:00100000:0.0:1788839680.897919:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720256 00000100:00100000:0.0:1788839680.897939:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720768 00000100:00100000:0.0:1788839680.897942:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720768 00000100:00100000:0.0:1788839680.897961:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720512 00000100:00100000:3.0:1788839680.897962:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060720640:12345-0@lo:400:kworker.0 Request processed in 51us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.897964:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720512 00000100:00100000:3.0:1788839680.897968:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788839680.897972:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721024 00000100:00100000:0.0:1788839680.897974:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721024 00000100:00100000:0.0:1788839680.897984:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721152 00000100:00100000:0.0:1788839680.897986:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721152 00000100:00100000:3.0:1788839680.897990:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788839680.898003:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060720256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839680.898054:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060720256:12345-0@lo:400:kworker.0 Request processed in 33us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898165:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788839680.898173:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060720768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898205:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060720768:12345-0@lo:400:kworker.0 Request processed in 34us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898211:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788839680.898224:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788839680.898230:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060720512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898253:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060720512:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898258:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788839680.898268:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839680.898274:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060721024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898325:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060721024:12345-0@lo:400:kworker.0 Request processed in 51us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898332:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839680.898344:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788839680.898349:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060721152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898372:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060721152:12345-0@lo:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898378:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788839680.898395:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720128 00000100:00100000:0.0:1788839680.898400:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720128 00000100:00100000:0.0:1788839680.898423:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788839680.898439:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060720128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898467:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060720128:12345-0@lo:400:kworker.0 Request processed in 39us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898473:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1788839680.898540:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721280 00000100:00100000:0.0:1788839680.898544:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721280 00000100:00100000:0.0:1788839680.898572:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788839680.898578:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060721280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898606:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060721280:12345-0@lo:400:kworker.0 Request processed in 28us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.898612:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788839680.898629:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060721408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839680.898653:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839680.898696:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839680.898699:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839680.898708:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839680.898718:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839680.898928:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898954:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839680.898982:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060720512:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.898992:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060721024:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899015:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720896 00000100:00100000:0.0:1788839680.899018:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720896 00000100:00100000:0.0:1788839680.899043:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788839680.899050:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060720896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899081:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060720896:12345-0@lo:400:kworker.0 Request processed in 32us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.899086:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788839680.899099:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788839680.899117:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7450db480 x1875734060720896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839680.899127:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060720896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899146:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060720128:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899157:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060720640:0@lo:400:kworker.0 00010000:00080000:0.0:1788839680.899167:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7477dbb80 x1875734060721152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839696 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839680.899174:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060721152:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899184:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060720256:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899206:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060720768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899216:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060721280:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899255:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060720384 00000100:00100000:0.0:1788839680.899259:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060720384 00000100:00100000:0.0:1788839680.899281:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788839680.899286:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060720384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899320:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060720384:12345-0@lo:400:kworker.0 Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.899326:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788839680.899351:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060720384:0@lo:400:kworker.0 00000100:00100000:0.0:1788839680.899391:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721408 00000100:00100000:0.0:1788839680.899395:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721408 00000100:00100000:0.0:1788839680.899417:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788839680.899423:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060721408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839680.899438:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839680.903026:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060721408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3591us (4361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839680.903041:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788839680.903122:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060721408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839680.904795:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788839681.407081:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839681.407106:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060721536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839681.407176:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839681.407399:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721536 00000100:00100000:0.0:1788839681.407409:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721536 00000100:00100000:0.0:1788839681.407458:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788839681.407467:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060721536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839681.407499:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788839681.407568:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060721536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839681.407576:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788839681.407662:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060721536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839681.706416:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839681.706464:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839681.706504:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839681.706542:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839681.706567:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839681.706593:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142592 00000100:00100000:1.0:1788839681.706601:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142592 00000100:00100000:1.0:1788839681.706649:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 379 00000100:00100000:1.0:1788839681.706659:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050142592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839681.706737:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050142592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839681.706745:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 379 00000100:00100000:3.0:1788839681.707349:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142720 00000100:00100000:3.0:1788839681.707356:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142720 00000100:00100000:3.0:1788839681.707399:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142976 00000100:00100000:3.0:1788839681.707401:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142976 00000100:00100000:3.0:1788839681.707415:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050142848 00000100:00100000:3.0:1788839681.707417:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050142848 00000100:00100000:3.0:1788839681.707430:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143104 00000100:00100000:3.0:1788839681.707433:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143104 00000100:00100000:3.0:1788839681.707447:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 269 00000100:00100000:3.0:1788839681.707454:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050142720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839681.707493:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050142720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839681.707500:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 269 00000100:00100000:3.0:1788839681.707513:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 270 00000100:00100000:3.0:1788839681.707520:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050142976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839681.707544:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050142976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839681.707550:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 270 00000100:00100000:3.0:1788839681.707563:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 271 00000100:00100000:3.0:1788839681.707569:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050142848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839681.707592:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050142848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839681.707608:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 271 00000100:00100000:3.0:1788839681.707621:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 272 00000100:00100000:3.0:1788839681.707627:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050143104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839681.707650:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050143104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839681.707655:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 272 00000100:00080000:0.0:1788839681.708692:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839681.708698:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788839681.855009:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839681.942393:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:2.0:1788839681.942402:0:9483:0:(genops.c:885:class_export_put()) final put ffff8ab777c22800/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:0.0:1788839681.942578:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777c22800/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-OST0001 00000020:00000080:0.0:1788839681.942627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab777c26800 for lustre-OST0001 00010000:00010000:3.0:1788839682.878952:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839683.456606:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839683.456749:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060721664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839683.457007:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839683.464295:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721664 00000100:00100000:0.0:1788839683.464310:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721664 00000100:00100000:2.0:1788839683.464433:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788839683.464443:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060721664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839683.464479:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788839683.464574:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060721664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (7567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839683.464581:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788839683.464684:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060721664:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788839683.715454:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788839683.775629:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839683.906818:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839684.927057:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839685.952270:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839686.019633:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839686.019657:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060721920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839686.019724:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839686.019865:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721920 00000100:00100000:3.0:1788839686.019884:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721920 00000100:00100000:1.0:1788839686.019927:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060721792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839686.020065:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788839686.020075:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060721920:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839686.020099:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788839686.020104:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839686.020154:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060721920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.020161:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788839686.020175:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060721792 00000100:00100000:3.0:1788839686.020178:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060721792 00000100:00100000:3.0:1788839686.020192:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788839686.020197:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060721792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839686.020210:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788839686.020314:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839686.020318:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839686.020412:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060721920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839686.023988:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060721792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3661us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.024003:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788839686.024089:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060722048:0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.024148:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839686.024220:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722048 00000100:00100000:3.0:1788839686.024228:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722048 00000100:00100000:3.0:1788839686.024268:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788839686.024276:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060722048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.024325:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7547d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060722048:12345-0@lo:400:kworker.0 Request processed in 50us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.024332:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788839686.024360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060722176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839686.024387:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839686.032151:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060722304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839686.032233:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839686.034122:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722176 00000100:00100000:0.0:1788839686.034136:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722176 00000100:00100000:0.0:1788839686.034207:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722304 00000100:00100000:0.0:1788839686.034211:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722304 00000100:00100000:0.0:1788839686.034231:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788839686.034243:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060722176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839686.034266:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839686.034336:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060722176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (9947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839686.034342:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788839686.034358:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788839686.034364:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060722304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839686.034374:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839686.034402:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060722304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839686.034407:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:0.0:1788839686.034438:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839686.034442:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839686.034852:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060722560:0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.034895:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839686.034937:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060722048:0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.034958:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839686.034964:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060722432:0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035002:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839686.035040:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722560 00000100:00100000:0.0:1788839686.035045:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722560 00000100:00100000:0.0:1788839686.035081:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788839686.035088:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060722560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035132:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060722560:12345-0@lo:400:kworker.0 Request processed in 44us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839686.035138:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788839686.035158:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060722688:0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839686.035216:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060722176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839686.035242:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060722560:0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035288:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722432 00000100:00100000:0.0:1788839686.035291:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722432 00000100:00100000:0.0:1788839686.035322:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722688 00000100:00100000:0.0:1788839686.035325:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722688 00000100:00100000:0.0:1788839686.035343:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788839686.035349:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060722432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035384:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060722432:12345-0@lo:400:kworker.0 Request processed in 35us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839686.035399:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788839686.035412:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788839686.035418:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060722688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035449:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060722688:12345-0@lo:400:kworker.0 Request processed in 32us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839686.035455:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788839686.035481:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060722688:0@lo:400:kworker.0 00000100:00100000:0.0:1788839686.035500:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060722432:0@lo:400:kworker.0 00010000:00080000:1.0:1788839686.038131:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7450e4700 x1875734060721792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839686.038168:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060721792:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788839686.038210:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7450e7800 x1875734060722304/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839702 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839686.038220:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060722304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839686.038543:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839686.038555:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060722944:0@lo:400:kworker.0 00000100:00100000:2.0:1788839686.038615:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839686.038656:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722944 00000100:00100000:2.0:1788839686.038662:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722944 00000100:00100000:3.0:1788839686.038667:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839686.038683:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060722816:0@lo:400:kworker.0 00000100:00100000:2.0:1788839686.038719:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788839686.038722:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839686.038745:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060722944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.038759:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060722816 00000100:00100000:3.0:1788839686.038764:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060722816 00000100:00100000:2.0:1788839686.038832:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060722944:12345-0@lo:400:kworker.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.038839:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839686.038842:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788839686.038851:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060722816:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788839686.038866:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839686.038890:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060722944:0@lo:400:kworker.0 00000100:00100000:2.0:1788839686.038923:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060723072:0@lo:400:kworker.0 00000100:00100000:2.0:1788839686.038960:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839686.039270:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060722816:12345-0@lo:400:kworker.0 Request processed in 421us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.039278:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788839686.039311:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060722816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.042865:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060723200:0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.043067:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839686.043123:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060723072 00000100:00100000:3.0:1788839686.043131:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060723072 00000100:00100000:3.0:1788839686.043190:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060723200 00000100:00100000:3.0:1788839686.043193:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060723200 00000100:00100000:3.0:1788839686.043219:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788839686.043227:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060723072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.043276:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060723072:12345-0@lo:400:kworker.0 Request processed in 49us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.043283:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788839686.043298:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788839686.043305:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060723200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.043332:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060723200:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.043337:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788839686.043372:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060723200:0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.043409:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839686.043416:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060723328:0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.043437:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839686.043483:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839686.043486:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839686.043495:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060723328 00000100:00100000:3.0:1788839686.043499:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060723328 00000100:00100000:3.0:1788839686.043526:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788839686.043532:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060723328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839686.044077:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060723328:12345-0@lo:400:kworker.0 Request processed in 543us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.044084:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1788839686.044103:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788839686.044124:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7450e4e00 x1875734060723328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839686.044145:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060723328:0@lo:400:kworker.0 00010000:00080000:2.0:1788839686.049324:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777e43b80 x1875734060723072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839702 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839686.049345:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060723072:0@lo:400:kworker.0 00000100:00100000:2.0:1788839686.528754:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060723456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839686.528875:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839686.529206:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060723456 00000100:00100000:1.0:1788839686.529215:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060723456 00000100:00100000:1.0:1788839686.529267:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788839686.529275:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060723456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839686.529308:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788839686.529361:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060723456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839686.529367:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839686.529460:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060723456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839686.825203:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839686.825251:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839686.825276:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839686.825295:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839686.825314:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839686.825339:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143488 00000100:00100000:3.0:1788839686.825348:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143488 00000100:00100000:2.0:1788839686.825398:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143744 00000100:00100000:2.0:1788839686.825404:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143744 00000100:00100000:3.0:1788839686.825409:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143360 00000100:00100000:3.0:1788839686.825414:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143360 00000100:00100000:2.0:1788839686.825442:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143616 00000100:00100000:2.0:1788839686.825447:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143616 00000100:00100000:3.0:1788839686.825454:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 279 00000100:00100000:3.0:1788839686.825466:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050143488:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839686.825474:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 280 00000100:00100000:2.0:1788839686.825484:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050143744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839686.825548:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050143488:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 85us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.825555:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 279 00000100:00100000:3.0:1788839686.825573:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 281 00000100:00100000:3.0:1788839686.825579:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050143360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839686.825818:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143232 00000100:00100000:1.0:1788839686.825823:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143232 00000100:00100000:1.0:1788839686.825860:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 381 00000100:00100000:1.0:1788839686.825868:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050143232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839686.829248:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050143744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 3754us (3958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839686.829263:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 280 00000100:00100000:2.0:1788839686.829302:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 282 00000100:00100000:2.0:1788839686.829335:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050143616:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839686.829390:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050143616:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 60us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839686.829397:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 282 00000100:00080000:2.0:1788839686.833971:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839686.833982:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839686.837444:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050143360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 11851us (12134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839686.837462:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 281 00000100:00100000:1.0:1788839686.837704:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050143232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 11834us (12508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839686.837714:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 381 00000001:02000400:1.0:1788839686.928423:0:14029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:54:44 (1788839684) 00010000:00010000:3.0:1788839686.975689:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839687.999058:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839688.575327:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060723584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839688.575409:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839688.575492:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060723584 00000100:00100000:0.0:1788839688.575500:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060723584 00000100:00100000:0.0:1788839688.575546:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788839688.575554:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060723584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839688.575588:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839688.575639:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060723584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839688.575646:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788839688.575914:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060723584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839688.695207:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839688.695808:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050143872 00000100:00100000:2.0:1788839688.695819:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050143872 00000100:00100000:2.0:1788839688.695911:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788839688.695923:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:11088:x1875734050143872:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839688.695954:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839688.695978:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb600/0xad5b343a26572e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7480f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.696043:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572e16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.696057:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.696071:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839688.696118:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839688.696122:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839688.696158:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572e16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.696181:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb600/0xad5b343a26572e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7480f expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.696214:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572e16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7480f expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.696221:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850e00) 00010000:00010000:2.0:1788839688.696224:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839688.696228:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413caa00, rc 0) 00000100:00100000:2.0:1788839688.696292:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:11088:x1875734050143872:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 372us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839688.696300:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00080000:3.0:1788839688.697014:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839688.704532:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839688.704626:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050144000 00000100:00100000:2.0:1788839688.704634:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050144000 00000100:00100000:2.0:1788839688.704687:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788839688.704697:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:11089:x1875734050144000:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839688.704717:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839688.704736:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb600/0xad5b343a26572e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74816 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.704839:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.704853:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.704863:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.704877:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.704991:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.704999:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705054:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413ca800/0xad5b343a26572e32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705061:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413ca800/0xad5b343a26572e32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705067:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413ca800/0xad5b343a26572e32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839688.705099:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839688.705103:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839688.705125:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413ca800/0xad5b343a26572e32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705135:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705572:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705580:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705586:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cae00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839688.705686:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705704:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705716:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850e00) 00010000:00010000:2.0:1788839688.705719:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839688.705723:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.705729:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cae00/0xad5b343a26572e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706045:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706054:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706060:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706065:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cb400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839688.706067:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706073:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706081:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab647850400) 00010000:00010000:2.0:1788839688.706083:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839688.706086:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706101:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb400/0xad5b343a26572e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706137:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413cb600/0xad5b343a26572e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74816 expref: 8 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706149:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413ca800/0xad5b343a26572e32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74816 expref: 7 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839688.706156:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647850000) 00010000:00010000:2.0:1788839688.706158:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839688.706160:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab7413ca800, rc 0) 00000100:00100000:2.0:1788839688.706222:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11089:x1875734050144000:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1525us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839688.706229:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788839688.714842:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839688.715069:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050144128 00000100:00100000:1.0:1788839688.715079:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050144128 00000100:00100000:1.0:1788839688.715143:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788839688.715155:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11089:x1875734050144128:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788839688.715244:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11089:x1875734050144128:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 92us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839688.715252:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788839688.717408:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839688.717487:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050144384 00000100:00100000:3.0:1788839688.717497:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050144384 00000100:00100000:3.0:1788839688.717560:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788839688.717571:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11089:x1875734050144384:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839688.717605:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839688.717626:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7481d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.717697:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.717711:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.717721:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.717845:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.717854:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.717861:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718317:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6a00/0xad5b343a26572e4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718339:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6a00/0xad5b343a26572e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718347:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6a00/0xad5b343a26572e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839688.718356:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788839688.718442:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718450:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718456:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718462:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839688.718467:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718473:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718485:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647850000) 00010000:00010000:3.0:1788839688.718487:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839688.718491:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718497:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718571:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718584:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718590:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718689:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839688.718693:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718700:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718709:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab64784f800) 00010000:00010000:3.0:1788839688.718711:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839688.718713:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.718719:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e47 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.719442:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7481d expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.719459:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6a00/0xad5b343a26572e4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7481d expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839688.719468:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:3.0:1788839688.719470:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839688.719479:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6a00, rc 0) 00000100:00100000:3.0:1788839688.719746:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11089:x1875734050144384:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2175us (2343us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788839688.719793:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788839688.725662:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839688.725760:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050144512 00000100:00100000:0.0:1788839688.725808:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050144512 00000100:00100000:0.0:1788839688.725867:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1788839688.725877:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11089:x1875734050144512:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788839688.725988:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11089:x1875734050144512:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 112us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839688.725996:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1788839688.728673:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839688.728943:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050144640 00000100:00100000:2.0:1788839688.728953:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050144640 00000100:00100000:2.0:1788839688.729027:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788839688.729039:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:11089:x1875734050144640:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788839688.729622:0:12241:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 542us 00000100:00080000:3.0:1788839688.730076:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839688.762700:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:11089:x1875734050144640:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 33653us (34026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839688.762715:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000040:00080000:0.0:1788839688.831755:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788839688.895599:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839689.028616:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839690.047141:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839690.905240:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839690.905311:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050144768 00000100:00100000:3.0:1788839690.905321:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050144768 00000100:00100000:3.0:1788839690.905404:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1788839690.905415:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11132:x1875734050144768:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839690.905436:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839690.905455:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74824 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905520:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905534:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905547:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905562:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905579:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905587:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905628:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905635:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905642:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905649:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839690.905653:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905661:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905672:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850e00) 00010000:00010000:3.0:1788839690.905675:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839690.905680:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905686:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905698:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905708:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905714:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905718:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839690.905721:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905727:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905734:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab647851700) 00010000:00010000:3.0:1788839690.905736:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839690.905739:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905744:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e6a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905811:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e5c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74824 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905822:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850e00) 00010000:00010000:3.0:1788839690.905824:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839690.905828:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74824 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.905838:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6800, rc 0) 00000100:00080000:0.0:1788839690.905969:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839690.906118:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11132:x1875734050144768:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 704us (886us total) trans 0 rc 301/301 00000100:00100000:3.0:1788839690.906126:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1788839690.910587:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839690.910711:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145024 00000100:00100000:3.0:1788839690.910720:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145024 00000100:00100000:3.0:1788839690.911026:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788839690.911038:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11132:x1875734050145024:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:3.0:1788839690.911101:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839690.911128:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413caa00/0xad5b343a26572e16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7480f expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911144:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647850e00) 00010000:00010000:3.0:1788839690.911154:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839690.911221:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911234:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911243:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911253:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911259:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911265:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911760:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911794:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911802:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839690.911818:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b78d8c52 reply state 00000000774f54c5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911830:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911837:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839690.911840:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839690.911842:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788839690.911847:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788839690.911854:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.911861:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912031:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912038:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839690.912042:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912061:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912070:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839690.912072:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839690.912076:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912081:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e71 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839690.912096:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b78d8c52 reply state 00000000774f54c5 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912105:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839690.912111:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab647851e00) 00010000:00010000:3.0:1788839690.912114:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839690.912116:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788839690.912262:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+10:11132:x1875734050145024:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 1224us (1679us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788839690.912271:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788839691.012742:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.012814:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145152 00000100:00100000:3.0:1788839691.012824:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145152 00000100:00100000:3.0:1788839691.012882:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788839691.012893:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+10:11140:x1875734050145152:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:3.0:1788839691.012918:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.013006:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7482b expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.013088:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.013100:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.013111:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.013150:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788839691.013153:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839691.013187:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.013207:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7482b expref: 12 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.013225:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7482b expref: 11 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.013232:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839691.013235:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839691.013238:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6800, rc 0) 00000100:00100000:3.0:1788839691.013297:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+11:11140:x1875734050145152:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 406us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.013304:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1788839691.054107:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.054558:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145280 00000100:00100000:3.0:1788839691.054569:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145280 00000100:00100000:3.0:1788839691.054644:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788839691.054654:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+11:11146:x1875734050145280:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839691.054674:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.054692:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74832 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055141:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055158:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055170:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055182:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055190:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055196:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055275:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a26572ea9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055284:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a26572ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055290:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a26572ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.055338:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788839691.055342:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839691.055381:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a26572ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055396:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055402:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055410:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055415:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839691.055420:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055428:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055440:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839691.055443:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839691.055453:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055459:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055483:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055499:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055506:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055511:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839691.055514:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055520:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055529:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab647851e00) 00010000:00010000:3.0:1788839691.055532:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839691.055534:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055540:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572ea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055565:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74832 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055576:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a26572ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74832 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.055583:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839691.055585:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788839691.055593:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078c00, rc 0) 00000100:00100000:3.0:1788839691.055817:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+12:11146:x1875734050145280:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1163us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.055827:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788839691.061181:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839691.061318:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145536 00000100:00100000:0.0:1788839691.061329:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145536 00000100:00100000:0.0:1788839691.061388:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788839691.061398:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+12:11146:x1875734050145536:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839691.061418:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839691.061437:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572eb0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74839 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.061549:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.061565:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.061578:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.061593:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.061600:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.061607:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839691.062647:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788839691.063705:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063725:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063737:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063810:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063819:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063826:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063832:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839691.063837:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063845:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063860:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839691.063871:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839691.063876:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063882:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26572eb7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839691.063910:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000699ad08d reply state 0000000011aeb124 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063922:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063928:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:0.0:1788839691.063930:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788839691.063933:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788839691.063971:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572eb0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.063987:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.064008:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:0.0:1788839691.064010:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839691.064013:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc600, rc 0) 00000100:00100000:0.0:1788839691.064084:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+15:11146:x1875734050145536:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2686us (2912us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788839691.064092:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00010000:00010000:3.0:1788839691.072083:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839691.072488:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.074131:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145664 00000100:00100000:1.0:1788839691.074144:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145664 00000100:00100000:1.0:1788839691.074213:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788839691.074224:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1875734050145664:12345-192.168.203.52@tcp:8:bash.0 00010000:00080000:1.0:1788839691.074264:0:8539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:1.0:1788839691.074302:0:8539:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26572ed3 00002000:00100000:1.0:1788839691.074334:0:8539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4c22f38d-5944-4459-a83e-bcbd490346fb/ffff8ab64816a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788839691.074353:0:8539:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type b7, return b7 00002000:00080000:1.0:1788839691.074438:0:8539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788839691.074484:0:8539:0:(import.c:65:import_set_state_nolock()) ffff8ab64816d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839691.074561:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050145664:12345-192.168.203.52@tcp:8:bash.0 Request processed in 337us (2078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.074569:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788839691.077732:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839691.077972:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145792 00000100:00100000:0.0:1788839691.077982:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145792 00000100:00100000:0.0:1788839691.078069:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00080000:3.0:1788839691.078075:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839691.078080:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:0:x1875734050145792:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839691.078098:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839691.078136:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74840 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839691.078164:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839691.078184:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:0.0:1788839691.078189:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839691.078199:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.078219:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.078232:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfde00, rc 0) 00000100:00100000:0.0:1788839691.078282:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:0:x1875734050145792:12345-192.168.203.52@tcp:101:bash.0 Request processed in 205us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839691.078289:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1788839691.081086:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.081576:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050145920 00000100:00100000:1.0:1788839691.081586:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050145920 00000100:00100000:1.0:1788839691.081640:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1788839691.081649:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11146:x1875734050145920:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839691.081665:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839691.081683:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74847 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.081710:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.081719:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839691.081723:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839691.081728:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 8 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.081812:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.081853:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839691.081869:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1875734060723712:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839691.081966:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419b7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839691.087914:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.088159:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1875734060723712:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839691.088194:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 8 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.088215:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959e00, rc 0) 00000100:00100000:1.0:1788839691.088312:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+8:11146:x1875734050145920:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6664us (7235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.088321:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1788839691.088603:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050146048 00000100:00100000:0.0:1788839691.088611:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050146048 00010000:00010000:0.0:1788839691.088645:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839691.088683:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788839691.088692:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050146048:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839691.088706:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839691.088727:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.088803:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.088828:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007935c97f/0xad5b343a26572eda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74840 expref: 8 pid: 8404 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.088842:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839691.088847:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839691.088862:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 7 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.088874:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 7 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.088909:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 7 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839691.088923:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6473:1875734060723840:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788839691.088980:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839691.099726:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.099826:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050146304 00000100:00100000:3.0:1788839691.099846:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050146304 00000100:00100000:3.0:1788839691.099912:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788839691.099922:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+15:11146:x1875734050146304:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1788839691.100234:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11146:x1875734050146304:12345-192.168.203.52@tcp:35:bash.0 Request processed in 312us (517us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788839691.100243:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788839691.102030:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6473:1875734060723840:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788839691.102056:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839691.102144:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050146048:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 13451us (14239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839691.102155:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788839691.135186:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060723968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839691.135223:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060724224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839691.136852:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839691.136874:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060724352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839691.136918:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.136945:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060724608:0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.136978:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.137001:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788839691.137008:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060724096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839691.137036:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.137049:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724608 00000100:00100000:2.0:1788839691.137058:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724608 00000100:00100000:3.0:1788839691.137082:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060723968 00000100:00100000:3.0:1788839691.137088:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060723968 00000100:00100000:2.0:1788839691.137104:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788839691.137121:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060724608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.137127:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724352 00000100:00100000:3.0:1788839691.137132:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724352 00000100:00100000:3.0:1788839691.137150:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724224 00000100:00100000:3.0:1788839691.137153:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724224 00000100:00100000:3.0:1788839691.137175:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788839691.137184:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060724608:12345-0@lo:400:kworker.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.137186:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060723968:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839691.137200:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00002000:00000024:3.0:1788839691.137236:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839691.137267:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839691.137276:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060723968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.137284:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788839691.137291:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060724480:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.137298:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724096 00000100:00100000:3.0:1788839691.137303:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724096 00000100:00100000:3.0:1788839691.137322:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788839691.137328:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839691.137333:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060724352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839691.137345:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839691.137374:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060724608:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.137382:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060724352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.137389:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788839691.137398:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060723968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839691.137404:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788839691.137411:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060724224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839691.137422:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788839691.137449:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839691.137455:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839691.137456:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060724224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.137463:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788839691.137473:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788839691.137479:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060724096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839691.137499:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839691.137503:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060724352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839691.137539:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060724096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.137548:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788839691.137550:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060724224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839691.137591:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060724096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839691.137813:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724480 00000100:00100000:2.0:1788839691.137819:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724480 00000100:00100000:2.0:1788839691.137852:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788839691.137913:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060724480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.137965:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060724480:12345-0@lo:400:kworker.0 Request processed in 106us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.137972:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788839691.138061:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060724480:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.138792:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060724864:0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.138838:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060724736:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.138846:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839691.139092:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060725120:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.142557:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060725376:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.142627:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839691.142691:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724864 00000100:00100000:3.0:1788839691.142699:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724864 00000100:00100000:3.0:1788839691.142824:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060725376 00000100:00100000:3.0:1788839691.142875:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060725376 00000100:00100000:3.0:1788839691.142923:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788839691.142933:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060724864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.143065:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060724864:12345-0@lo:400:kworker.0 Request processed in 132us (4218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.143073:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788839691.143109:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788839691.143115:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060725376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.143145:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060725376:12345-0@lo:400:kworker.0 Request processed in 30us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.143151:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788839691.143193:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060724864:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.143203:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060725376:0@lo:400:kworker.0 00000100:00080000:3.0:1788839691.143242:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839691.146563:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060724992:0@lo:400:kworker.0 00000100:00100000:0.0:1788839691.149137:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839691.149435:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060725504:0@lo:400:kworker.0 00000100:00100000:0.0:1788839691.149494:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839691.149547:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060725504 00000100:00100000:0.0:1788839691.149554:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060725504 00000100:00100000:0.0:1788839691.149618:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788839691.149628:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060725504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839691.149681:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060725504:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839691.149688:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:0.0:1788839691.149707:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788839691.149733:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7443da300 x1875734060725504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839691.149758:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060725504:0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.150112:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.154484:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060725248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.154570:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.154666:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060725248 00000100:00100000:2.0:1788839691.154674:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060725248 00000100:00100000:2.0:1788839691.154731:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788839691.154740:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060725248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.154820:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060725248:12345-0@lo:400:kworker.0 Request processed in 80us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.154827:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:2.0:1788839691.154998:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6480f5c00 x1875734060725248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839707 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839691.155019:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060725248:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.155175:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724992 00000100:00100000:3.0:1788839691.155180:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724992 00000100:00080000:3.0:1788839691.155216:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839691.155226:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839691.155256:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060725120 00000100:00100000:3.0:1788839691.155260:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060725120 00000100:00100000:3.0:1788839691.155318:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788839691.155325:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060725120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.155364:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060725120:12345-0@lo:400:kworker.0 Request processed in 40us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.155371:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00080000:1.0:1788839691.155526:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839691.155548:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060725120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.156052:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060724736 00000100:00100000:2.0:1788839691.156059:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060724736 00000100:00100000:2.0:1788839691.156075:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788839691.156081:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060724992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.156139:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060724992:12345-0@lo:400:kworker.0 Request processed in 58us (8546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.156145:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788839691.156157:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788839691.156171:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060724736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.156205:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060724736:12345-0@lo:400:kworker.0 Request processed in 36us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.156210:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788839691.156238:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060724736:0@lo:400:kworker.0 00000100:00100000:3.0:1788839691.157867:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060724992:0@lo:400:kworker.0 00000100:00100000:2.0:1788839691.192006:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839691.192097:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050146560 00000100:00100000:0.0:1788839691.192106:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050146560 00000100:00100000:0.0:1788839691.192166:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788839691.192177:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11156:x1875734050146560:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839691.192201:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839691.192222:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7484e expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839691.192320:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788839691.192417:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572ee8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7484e expref: 18 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.192447:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:0.0:1788839691.192450:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839691.192455:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7484e expref: 18 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839691.192479:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfde00, rc 0) 00000100:00100000:0.0:1788839691.192545:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+17:11156:x1875734050146560:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 370us (549us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788839691.192552:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1788839691.201315:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.201405:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050146816 00000100:00100000:1.0:1788839691.201414:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050146816 00000100:00100000:1.0:1788839691.201568:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788839691.201578:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+17:11156:x1875734050146816:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839691.202158:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11156:x1875734050146816:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 580us (851us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788839691.202166:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788839691.272335:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839691.272429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050146944 00000100:00100000:2.0:1788839691.272439:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050146944 00000100:00100000:2.0:1788839691.272507:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788839691.272518:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11162:x1875734050146944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839691.272542:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839691.272563:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74855 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.272627:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572efd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.272641:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.272653:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839691.272699:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788839691.272703:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839691.272723:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572efd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.272832:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74855 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.272852:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572efd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74855 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.272860:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839691.272872:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839691.272875:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839691.272928:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11162:x1875734050146944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 412us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.272935:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788839691.278014:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.278089:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050147200 00000100:00100000:3.0:1788839691.278099:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050147200 00000100:00100000:3.0:1788839691.278160:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788839691.278170:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11162:x1875734050147200:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839691.278192:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.278212:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26572f04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7485c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.278316:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.278340:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.278352:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.278364:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788839691.278466:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26572f04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7485c expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.278485:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7485c expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.278509:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:3.0:1788839691.278512:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839691.278515:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078000, rc 0) 00000100:00100000:3.0:1788839691.278577:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+21:11162:x1875734050147200:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 408us (571us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788839691.278584:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788839691.281936:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839691.281978:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839691.282057:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050147456 00000100:00100000:2.0:1788839691.282066:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050147456 00000100:00100000:2.0:1788839691.282126:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1788839691.282135:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+21:11162:x1875734050147456:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839691.282158:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839691.282186:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572f19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74863 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.282285:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f20 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.282301:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.282330:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f20 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839691.282343:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788839691.282448:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26572f19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74863 expref: 24 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.282466:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74863 expref: 23 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.282474:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:2.0:1788839691.282477:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839691.282481:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843c00, rc 0) 00000100:00100000:2.0:1788839691.282536:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+23:11162:x1875734050147456:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 402us (608us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788839691.282544:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788839691.282703:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050147584 00000100:00100000:1.0:1788839691.282709:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050147584 00000100:00100000:1.0:1788839691.282758:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788839691.282766:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+23:2392:x1875734050147584:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839691.282800:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839691.282816:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7485c expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.282829:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:1.0:1788839691.282832:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839691.282858:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2392:x1875734050147584:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 94us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.282865:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1788839691.293214:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.293582:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050147712 00000100:00100000:1.0:1788839691.293591:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050147712 00000100:00100000:1.0:1788839691.293679:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788839691.293689:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050147712:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:1.0:1788839691.293743:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.293800:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 7 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.293827:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839691.293832:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839691.293836:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.294302:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 7 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.294319:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 7 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839691.294335:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8539:1875734060725632:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839691.294531:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419b7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788839691.300035:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.300388:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050147840 00000100:00100000:3.0:1788839691.300407:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050147840 00002000:00100000:3.0:1788839691.300454:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ab7477d8380 x1875734050147840/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:82/0 lens 504/0 e 0 to 0 dl 1788839702 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839691.300639:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab7477d8380 with x1875734050147840 ext(0->12) 00010000:00010000:3.0:1788839691.300648:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 8 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.300666:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 8 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839691.300674:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab7477d8380 00000100:00100000:2.0:1788839691.300756:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8539:1875734060725632:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839691.300759:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1788839691.300783:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050147840:12345-192.168.203.52@tcp:4:lfs.0 00010000:00010000:2.0:1788839691.300795:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1788839691.302944:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000100:00100000:3.0:1788839691.304926:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2390:x1875734050147840:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 4148us (4889us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788839691.304939:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:3.0:1788839691.304951:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8ab7477d8380 x1875734050147840/t4294967300(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:82/0 lens 504/448 e 0 to 0 dl 1788839702 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839691.304974:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab7477d8380 with x1875734050147840 ext(0->12) 00010000:00010000:3.0:1788839691.304985:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 9 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.305004:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 9 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839691.305017:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab7477d8380 00000100:00100000:2.0:1788839691.308657:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.308851:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050147968 00000100:00100000:1.0:1788839691.308862:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050147968 00010000:00010000:1.0:1788839691.308903:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 9 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839691.308948:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788839691.308958:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2392:x1875734050147968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839691.308972:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788839691.308990:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788839691.309006:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788839690 00002000:00010000:1.0:1788839691.309009:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788839690 00002000:00010000:1.0:1788839691.309011:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788839690 00002000:00010000:1.0:1788839691.309013:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788839691.309019:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 9 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.309033:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 9 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.309057:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f12f4a4a/0xad5b343a26572ee1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74847 expref: 9 pid: 8538 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.309074:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839691.309078:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839691.309083:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.309093:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.309127:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839691.309188:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2392:x1875734050147968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 231us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.309195:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00010000:00010000:2.0:1788839691.310576:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310592:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310631:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310639:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310647:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310654:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839691.310658:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310666:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310681:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.310688:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d54241b/0xad5b343a26572f2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839691.310764:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050147712:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 17075us (17614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.310798:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788839691.314458:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.314646:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050148224 00000100:00100000:3.0:1788839691.314655:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050148224 00000100:00100000:3.0:1788839691.314705:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788839691.314713:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11162:x1875734050148224:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788839691.314837:0:6491:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f20 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74863 expref: 22 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839691.315034:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788839691.315071:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788839691.319349:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788839691.319418:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.319438:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 26 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.319448:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.319488:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 26 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.319505:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 26 pid: 6489 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839691.319519:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875734060725760:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839691.319614:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839691.322615:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839691.322726:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875734060725760:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839691.322764:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839691.323118:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050148352 00000100:00100000:1.0:1788839691.323126:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050148352 00010000:00010000:1.0:1788839691.323160:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 27 pid: 6489 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839691.323206:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:1.0:1788839691.323361:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+27:2389:x1875734050148352:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839691.323377:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839691.323384:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 27 pid: 6489 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.323396:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 27 pid: 6489 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.323418:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26572ec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74839 expref: 27 pid: 6489 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.323433:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:1.0:1788839691.323438:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.323446:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.323454:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.323482:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839691.323601:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.323609:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839691.323710:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1788839691.323869:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1788839691.323963:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060725888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788839691.324244:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+28:2389:x1875734050148352:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1029us (1638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.324255:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1788839691.324480:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.324636:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742890e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839691.325938:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060725888 00000100:00100000:1.0:1788839691.325958:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060725888 00000100:00100000:1.0:1788839691.326016:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788839691.326025:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1875734060725888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788839691.326129:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1875734060725888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 106us (1649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.326136:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788839691.326321:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060725888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839691.326474:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788839691.326534:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060726016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839691.326566:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839691.326621:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839691.326650:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060726016 00000100:00100000:0.0:1788839691.326654:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060726016 00000100:00100000:0.0:1788839691.326683:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788839691.326689:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6491:x1875734060726016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788839691.327029:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6491:x1875734060726016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 339us (461us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788839691.327036:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788839691.327085:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060726016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839691.327123:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788839691.327149:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.327159:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.327167:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.327173:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839691.327178:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.327186:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.327199:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:2.0:1788839691.327202:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788839691.327206:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.327220:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f35 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839691.327298:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788839691.327349:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788839691.327358:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346271587362ns, next at 347271585819ns, rc = 0 00000001:00080000:2.0:1788839691.327364:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788839691.327380:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad1d00) 00010000:00010000:2.0:1788839691.327383:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839691.327390:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f20 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74863 expref: 30 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839691.327501:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+29:11162:x1875734050148224:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 12788us (13051us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788839691.327509:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000020:00080000:2.0:1788839691.327513:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788839691.330403:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.330472:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050148480 00000100:00100000:3.0:1788839691.330482:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050148480 00000100:00100000:3.0:1788839691.330537:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788839691.330547:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+29:11162:x1875734050148480:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839691.330569:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.330590:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26572f3c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7486a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.330642:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26572f3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7486a expref: 30 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.330669:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26572f3c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7486a expref: 30 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.330689:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839691.330692:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839691.330696:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079200, rc 0) 00000100:00100000:3.0:1788839691.331061:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11162:x1875734050148480:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 514us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.331068:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788839691.333692:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.333928:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050148736 00000100:00100000:1.0:1788839691.333938:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050148736 00000100:00100000:1.0:1788839691.333997:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1788839691.334008:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11162:x1875734050148736:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839691.334206:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+31:11162:x1875734050148736:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 200us (524us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788839691.334214:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839691.400618:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.400711:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050148992 00000100:00100000:3.0:1788839691.400721:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050148992 00000100:00100000:3.0:1788839691.400824:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1788839691.400834:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+31:11172:x1875734050148992:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839691.400859:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.400888:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572f43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74871 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.400986:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788839691.401082:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572f43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74871 expref: 33 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.401097:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839691.401099:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839691.401105:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572f43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74871 expref: 33 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.401137:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078200, rc 0) 00000100:00100000:3.0:1788839691.401187:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11172:x1875734050148992:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 354us (578us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788839691.401194:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1788839691.404966:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839691.405114:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050149120 00000100:00100000:2.0:1788839691.405123:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050149120 00000100:00100000:2.0:1788839691.405189:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788839691.405199:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11172:x1875734050149120:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788839691.405278:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405295:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405307:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405332:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405340:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405347:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405438:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405447:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405454:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839691.405501:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405513:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405520:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405526:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405532:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839691.405537:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405551:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405564:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839691.405567:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839691.405571:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405577:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26572f51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405591:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405596:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405602:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405607:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839691.405610:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405616:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405623:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:2.0:1788839691.405625:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839691.405628:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405643:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405653:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405659:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405664:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405669:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839691.405672:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405679:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405686:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839691.405689:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839691.405692:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.405697:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26572f5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839691.405823:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11172:x1875734050149120:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 625us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.405831:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1788839691.412695:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.412966:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050149376 00000100:00100000:1.0:1788839691.412977:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050149376 00000100:00100000:1.0:1788839691.413037:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1788839691.413047:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11172:x1875734050149376:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839691.413280:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+33:11172:x1875734050149376:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 233us (594us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788839691.413288:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788839691.463183:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.463275:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050149632 00000100:00100000:3.0:1788839691.463285:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050149632 00000100:00100000:3.0:1788839691.463344:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788839691.463353:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+33:11175:x1875734050149632:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839691.463378:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.463398:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572f66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74878 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463470:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463485:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463496:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463509:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463516:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463523:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463665:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463674:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463681:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.463690:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788839691.463823:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463830:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463837:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463843:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839691.463847:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463855:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463867:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839691.463870:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839691.463875:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463893:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26572f6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463908:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463915:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463921:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463927:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839691.463930:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463936:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463944:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:3.0:1788839691.463946:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839691.463950:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463955:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572f74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.463993:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572f66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 36 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.464019:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 35 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.464026:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839691.464028:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839691.464031:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7800, rc 0) 00000100:00100000:3.0:1788839691.464107:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11175:x1875734050149632:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 746us (924us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788839691.464115:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788839691.468392:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839691.468561:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050149760 00000100:00100000:2.0:1788839691.468571:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050149760 00000100:00100000:2.0:1788839691.468642:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1788839691.468652:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11175:x1875734050149760:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788839691.468727:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468755:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468766:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468835:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468841:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468847:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468853:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839691.468857:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468873:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468885:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839691.468888:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839691.468891:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.468907:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26572f89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839691.468980:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11175:x1875734050149760:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 329us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.468988:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1788839691.472145:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.472356:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050150016 00000100:00100000:1.0:1788839691.472367:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050150016 00000100:00100000:1.0:1788839691.472433:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1788839691.472443:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11175:x1875734050150016:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839691.472675:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+36:11175:x1875734050150016:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 233us (539us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788839691.472699:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788839691.650400:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839691.650426:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060726144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839691.650511:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839691.651007:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060726144 00000100:00100000:0.0:1788839691.651016:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060726144 00000100:00100000:0.0:1788839691.651067:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788839691.651076:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060726144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839691.651119:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:0.0:1788839691.651177:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060726144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839691.651185:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788839691.651336:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060726144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839691.831235:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.832349:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050150272 00000100:00100000:3.0:1788839691.832361:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050150272 00000100:00100000:3.0:1788839691.832568:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788839691.832580:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+36:11206:x1875734050150272:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788839691.832845:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.832874:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572f90 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7487f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.832991:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572f97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.833009:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.833037:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.833049:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788839691.833203:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572f90 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7487f expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.833226:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7487f expref: 38 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.833235:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839691.833238:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839691.833242:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7e00, rc 0) 00000100:00100000:3.0:1788839691.833476:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11206:x1875734050150272:12345-192.168.203.52@tcp:101:cat.0 Request processed in 898us (2250us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788839691.833484:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788839691.837187:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839691.837322:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.837655:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050150656 00000100:00100000:1.0:1788839691.837664:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050150656 00000100:00100000:1.0:1788839691.837724:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788839691.837734:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11206:x1875734050150656:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1788839691.838028:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+39:11206:x1875734050150656:12345-192.168.203.52@tcp:35:cat.0 Request processed in 295us (704us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788839691.838035:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788839691.840966:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050150400 00000100:00100000:2.0:1788839691.840984:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050150400 00000100:00100000:2.0:1788839691.841157:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1788839691.841169:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+39:2391:x1875734050150400:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839691.841185:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839691.841210:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572f97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7487f expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.841232:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839691.841237:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839691.841298:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+38:2391:x1875734050150400:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 131us (4121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.841306:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788839691.898703:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.898894:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050150912 00000100:00100000:3.0:1788839691.898904:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050150912 00000100:00100000:3.0:1788839691.898964:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788839691.898974:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11212:x1875734050150912:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788839691.898997:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839691.899000:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788839691.899026:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26572efd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74855 expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.899045:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839691.899062:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839691.899078:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572fa5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74886 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.899196:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.899210:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 38 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.899218:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.899250:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 38 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.899263:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 38 pid: 12241 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839691.899275:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060726272:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839691.899370:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf780 going to sleep for 11 seconds 00000100:00100000:0.0:1788839691.903019:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.903099:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151040 00000100:00100000:1.0:1788839691.903108:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151040 00010000:00010000:1.0:1788839691.903147:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 39 pid: 12241 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839691.903181:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788839691.903189:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+39:2389:x1875734050151040:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839691.903204:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839691.903210:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 39 pid: 12241 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.903223:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 39 pid: 12241 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.903243:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:1.0:1788839691.903248:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.903270:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.903278:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839691.903296:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839691.903351:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+39:2389:x1875734050151040:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 161us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.903359:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00010000:00010000:3.0:1788839691.903858:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26572f7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74878 expref: 38 pid: 12241 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839691.903875:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060726272:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839691.903897:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.903906:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.903921:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839691.903943:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788839691.904099:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26572fa5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 39 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.904114:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 38 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.904122:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839691.904124:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788839691.904126:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7e00, rc 0) 00000100:00100000:3.0:1788839691.904170:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11212:x1875734050150912:12345-192.168.203.52@tcp:101:dd.0 Request processed in 5197us (5476us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788839691.904177:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788839691.907808:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839691.908117:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151168 00000100:00100000:2.0:1788839691.908127:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151168 00000100:00100000:2.0:1788839691.908189:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1788839691.908199:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11212:x1875734050151168:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788839691.908224:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839691.908244:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572fba lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7488d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.908292:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.908305:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.908316:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.908440:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26572fba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 40 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.908456:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 39 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839691.908465:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839691.908468:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839691.908472:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843400, rc 0) 00000100:00100000:2.0:1788839691.908540:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+39:11212:x1875734050151168:12345-192.168.203.52@tcp:101:dd.0 Request processed in 342us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.908546:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1788839691.911182:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.911251:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151424 00000100:00100000:3.0:1788839691.911264:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151424 00000100:00100000:3.0:1788839691.911318:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1788839691.911327:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+39:11212:x1875734050151424:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:3.0:1788839691.911549:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.911566:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.911577:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839691.911649:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788839691.911671:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000964acdc reply state 0000000016079dc8 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.911683:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839691.911691:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839691.911695:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839691.911699:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839691.911833:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+42:11212:x1875734050151424:12345-192.168.203.52@tcp:36:dd.0 Request processed in 505us (657us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788839691.911839:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:3.0:1788839691.911844:0:6489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788839691.943933:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.943978:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.944020:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.944238:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151552 00000100:00100000:1.0:1788839691.944247:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151552 00000100:00100000:1.0:1788839691.944304:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 383 00000100:00100000:1.0:1788839691.944314:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050151552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839691.944384:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab753f1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050151552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 71us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839691.944391:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 383 00000100:00100000:0.0:1788839691.944523:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151808 00000100:00100000:0.0:1788839691.944527:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151808 00000100:00100000:0.0:1788839691.944565:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788839691.944572:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050151808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839691.944600:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777f22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050151808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839691.944606:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788839691.945152:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050152064 00000100:00100000:2.0:1788839691.945159:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050152064 00000100:00100000:2.0:1788839691.945204:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 289 00000100:00100000:2.0:1788839691.945212:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050152064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839691.945245:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050152064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839691.945267:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 289 00000100:00080000:1.0:1788839691.945875:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839691.953139:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839691.953176:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839691.953334:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151680 00000100:00100000:3.0:1788839691.953344:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151680 00000100:00100000:3.0:1788839691.953421:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050151936 00000100:00100000:3.0:1788839691.953426:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050151936 00000100:00100000:3.0:1788839691.953452:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 290 00000100:00100000:3.0:1788839691.953461:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050151680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839691.953532:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050151680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.953539:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 290 00000100:00100000:3.0:1788839691.953554:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:3.0:1788839691.953560:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050151936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839691.953598:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050151936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839691.953605:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00080000:1.0:1788839691.954252:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839691.954258:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788839692.095552:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839692.249867:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839692.250002:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050152192 00000100:00100000:0.0:1788839692.250013:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050152192 00000100:00100000:0.0:1788839692.250124:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788839692.250136:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+42:11226:x1875734050152192:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1788839692.250158:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839692.250189:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572fcf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74894 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250252:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250268:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250280:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250290:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250296:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250302:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250387:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250399:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 43 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250406:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250442:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 43 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.250468:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 43 pid: 6487 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839692.250482:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060726400:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839692.250587:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0300 going to sleep for 11 seconds 00000100:00080000:1.0:1788839692.250654:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839692.255675:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839692.255807:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050152448 00000100:00100000:1.0:1788839692.255817:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050152448 00000100:00100000:1.0:1788839692.255884:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1788839692.255894:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+44:9933:x1875734050152448:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788839692.256222:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+45:9933:x1875734050152448:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 329us (559us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788839692.256231:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788839692.258942:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a18a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060726400:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839692.258981:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839692.262117:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839692.262263:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050152576 00000100:00100000:1.0:1788839692.262273:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050152576 00010000:00010000:1.0:1788839692.262312:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 45 pid: 6487 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839692.262358:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788839692.262368:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+45:2390:x1875734050152576:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839692.262383:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839692.262389:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 45 pid: 6487 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.262402:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 45 pid: 6487 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.262423:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26572fac lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74886 expref: 45 pid: 6487 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.262439:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:1.0:1788839692.262444:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.262454:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.262461:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.262501:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839692.262552:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+44:2390:x1875734050152576:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 185us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839692.262560:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00010000:00010000:0.0:1788839692.264849:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.264877:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839692.264935:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788839692.264939:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839692.264987:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265004:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265013:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265020:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265042:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265049:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839692.265054:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265061:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265076:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839692.265079:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839692.265083:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265090:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572fd6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265105:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265111:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265115:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265120:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfca00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839692.265123:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265138:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265148:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:0.0:1788839692.265150:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839692.265154:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265159:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572fdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265195:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26572fcf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74894 expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265208:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74894 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.265215:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:0.0:1788839692.265217:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839692.265219:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfce00, rc 0) 00000100:00100000:0.0:1788839692.265291:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+43:11226:x1875734050152192:12345-192.168.203.52@tcp:101:stat.0 Request processed in 15157us (15433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839692.265300:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1788839692.367041:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839692.367124:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050152832 00000100:00100000:3.0:1788839692.367134:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050152832 00000100:00100000:3.0:1788839692.367359:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1788839692.367381:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+43:11232:x1875734050152832:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:3.0:1788839692.367439:0:7438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839692.367466:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26572fe4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74894 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.367484:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839692.367488:0:7438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839692.367668:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.367682:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.367691:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839692.367767:0:7438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788839692.367870:0:7438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b853e5d6 reply state 000000000f01a07f transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.367882:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.367894:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839692.367897:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839692.367899:0:7438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839692.368007:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+45:11232:x1875734050152832:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 638us (975us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788839692.368014:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000020:00080000:3.0:1788839692.368020:0:7438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788839692.542416:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839692.542509:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050152960 00000100:00100000:0.0:1788839692.542520:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050152960 00000100:00100000:0.0:1788839692.542580:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788839692.542592:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+45:11246:x1875734050152960:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1788839692.542636:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839692.542658:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572ff2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7489b expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542725:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542751:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542762:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542808:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542816:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542822:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542883:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542890:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542896:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839692.542933:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788839692.542942:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839692.542962:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542975:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542982:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542989:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.542995:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543000:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839692.543004:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543012:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543023:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839692.543026:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839692.543030:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543036:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26572ff9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543048:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543064:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543069:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543074:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839692.543077:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543084:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543091:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:0.0:1788839692.543094:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839692.543097:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543103:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a26573000 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543126:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26572ff2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 47 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543138:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 46 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.543145:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:0.0:1788839692.543148:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839692.543155:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc000, rc 0) 00000100:00100000:0.0:1788839692.543209:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+46:11246:x1875734050152960:12345-192.168.203.52@tcp:101:stat.0 Request processed in 622us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839692.543216:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788839692.648916:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839692.649024:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050153216 00000100:00100000:2.0:1788839692.649034:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050153216 00000100:00100000:2.0:1788839692.649097:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788839692.649106:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+46:11256:x1875734050153216:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839692.649128:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839692.649151:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657300e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748a2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839692.649267:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788839692.649373:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657300e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a2 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.649387:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:2.0:1788839692.649390:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839692.649396:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657300e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a2 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.649410:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843a00, rc 0) 00000100:00100000:2.0:1788839692.649474:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+47:11256:x1875734050153216:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 369us (571us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788839692.649481:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788839692.652577:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839692.652667:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050153472 00000100:00100000:1.0:1788839692.652677:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050153472 00000100:00100000:1.0:1788839692.652749:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1788839692.652760:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+47:11256:x1875734050153472:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839692.653014:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+48:11256:x1875734050153472:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 255us (445us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1788839692.653022:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788839692.749418:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839692.749515:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050153728 00000100:00100000:2.0:1788839692.749528:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050153728 00000100:00100000:2.0:1788839692.749606:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:2.0:1788839692.749619:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+48:11262:x1875734050153728:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839692.749646:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839692.749668:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657301c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748a9 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.749834:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.749851:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 49 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.749859:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.749894:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 49 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.749908:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 49 pid: 12241 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839692.749923:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab74779b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060726528:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839692.750094:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839692.761193:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839692.761294:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050153856 00000100:00100000:1.0:1788839692.761304:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050153856 00010000:00010000:1.0:1788839692.761351:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 50 pid: 12241 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839692.761425:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1788839692.761436:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+50:2390:x1875734050153856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839692.761461:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839692.761469:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 50 pid: 12241 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.761483:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 50 pid: 12241 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.761508:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:1.0:1788839692.761527:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.761538:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.761547:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.761566:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839692.761626:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+50:2390:x1875734050153856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 191us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839692.761634:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00010000:00010000:2.0:1788839692.764525:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573007 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7489b expref: 49 pid: 12241 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839692.764575:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab74779b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060726528:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839692.764729:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.764752:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.764759:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839692.764820:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788839692.765152:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657301c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 50 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.765170:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 49 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.765180:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839692.765183:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839692.765186:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842000, rc 0) 00000100:00100000:2.0:1788839692.765319:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+49:11262:x1875734050153728:12345-192.168.203.52@tcp:101:bash.0 Request processed in 15702us (15912us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788839692.765329:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788839692.769346:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839692.769450:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050154112 00000100:00100000:3.0:1788839692.769459:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050154112 00000100:00100000:3.0:1788839692.769514:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788839692.769524:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+49:11262:x1875734050154112:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1788839692.770109:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.770128:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.770139:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839692.770182:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788839692.770216:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a0ae65b reply state 00000000b74736a0 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.770229:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.770236:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839692.770251:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839692.770255:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839692.770345:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+52:11262:x1875734050154112:12345-192.168.203.52@tcp:36:bash.0 Request processed in 822us (1007us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788839692.770353:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000020:00080000:3.0:1788839692.770358:0:12241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788839692.775400:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839692.776400:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050154240 00000100:00100000:0.0:1788839692.776423:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050154240 00000100:00100000:0.0:1788839692.776504:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788839692.776515:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+52:11262:x1875734050154240:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839692.776540:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839692.776563:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573038 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748b0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.776669:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.776685:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 53 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.776694:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.776747:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 53 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.776761:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 53 pid: 7438 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839692.776961:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060726656:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839692.777055:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839692.781125:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060726656:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839692.781160:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839692.787308:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839692.787449:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050154368 00000100:00100000:0.0:1788839692.787459:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050154368 00010000:00010000:0.0:1788839692.787498:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 54 pid: 7438 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839692.787539:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788839692.787549:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+54:2389:x1875734050154368:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839692.787564:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839692.787571:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 54 pid: 7438 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.787585:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 54 pid: 7438 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.787620:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573023 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748a9 expref: 54 pid: 7438 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.787637:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:0.0:1788839692.787642:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.787652:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.787678:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839692.787710:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839692.788944:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.788958:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839692.789014:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788839692.789018:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839692.789039:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.789078:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573038 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748b0 expref: 54 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.789098:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748b0 expref: 53 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.789107:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839692.789109:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839692.789112:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd400, rc 0) 00000100:00100000:0.0:1788839692.789224:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+53:2389:x1875734050154368:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1674us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839692.789233:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1788839692.796096:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+52:11262:x1875734050154240:12345-192.168.203.52@tcp:101:bash.0 Request processed in 19569us (20692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839692.796110:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788839692.802151:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839692.802418:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050154624 00000100:00100000:1.0:1788839692.802429:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050154624 00000100:00100000:1.0:1788839692.802487:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788839692.802498:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e579050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+52:11262:x1875734050154624:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1788839692.803301:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e579050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+53:11262:x1875734050154624:12345-192.168.203.52@tcp:35:bash.0 Request processed in 800us (1157us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788839692.803311:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788839692.895650:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839692.895927:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050154880 00000100:00100000:2.0:1788839692.895937:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050154880 00000100:00100000:2.0:1788839692.896046:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788839692.896058:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+53:11272:x1875734050154880:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839692.896085:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839692.896115:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573046 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748b7 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839692.896225:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788839692.896317:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573046 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748b7 expref: 55 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.896333:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:2.0:1788839692.896336:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839692.896341:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573046 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748b7 expref: 55 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.896356:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843200, rc 0) 00000100:00100000:2.0:1788839692.896417:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+54:11272:x1875734050154880:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 362us (777us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788839692.896425:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788839692.922399:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839692.922492:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050155008 00000100:00100000:3.0:1788839692.922502:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050155008 00000100:00100000:3.0:1788839692.922565:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1788839692.922575:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+54:11272:x1875734050155008:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788839692.922668:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.922687:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.922699:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.922709:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.922716:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.922722:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.922850:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.923831:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.923844:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839692.923987:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924002:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924008:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924016:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924022:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839692.924026:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924033:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924045:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839692.924048:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839692.924052:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924059:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573054 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924088:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924094:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924099:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924104:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839692.924108:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924114:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924121:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:3.0:1788839692.924123:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839692.924126:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924132:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657305b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924140:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924145:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924151:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924163:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839692.924166:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924172:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924181:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839692.924183:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839692.924186:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839692.924191:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839692.924290:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+54:11272:x1875734050155008:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1713us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839692.924300:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788839692.927348:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839692.928728:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050155264 00000100:00100000:3.0:1788839692.928746:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050155264 00000100:00100000:3.0:1788839692.928988:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788839692.929000:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+54:11272:x1875734050155264:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839692.929226:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+55:11272:x1875734050155264:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 228us (1886us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788839692.929233:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788839692.973912:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839692.974073:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050155520 00000100:00100000:2.0:1788839692.974083:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050155520 00000100:00100000:2.0:1788839692.974133:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839692.974142:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+55:11275:x1875734050155520:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839692.974168:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839692.974190:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26573069 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748be expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974272:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974288:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974314:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974327:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974334:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974340:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974461:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657307e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974472:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657307e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974479:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657307e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839692.974488:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788839692.974555:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974563:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974569:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974575:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839692.974586:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974919:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974932:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839692.974935:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839692.974940:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974946:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a26573070 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974959:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974965:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974970:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974975:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839692.974978:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974983:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.974990:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:2.0:1788839692.974992:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839692.975002:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.975008:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573077 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.975049:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a26573069 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748be expref: 58 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.975064:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657307e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748be expref: 57 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.975071:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839692.975073:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839692.975075:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843200, rc 0) 00000100:00100000:2.0:1788839692.975194:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+57:11275:x1875734050155520:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1052us (1289us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788839692.975202:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839692.986602:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839692.986662:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839692.986761:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050155776 00000100:00100000:1.0:1788839692.986761:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050155648 00000100:00100000:1.0:1788839692.986788:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050155648 00000100:00100000:3.0:1788839692.986790:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050155776 00000100:00100000:1.0:1788839692.986913:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788839692.986928:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+58:2391:x1875734050155648:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839692.986945:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788839692.987021:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00010000:00010000:1.0:1788839692.987132:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657307e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748be expref: 58 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839692.987151:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:1.0:1788839692.987156:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839692.987208:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+57:2391:x1875734050155648:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 281us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839692.987217:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788839692.998438:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+56:11275:x1875734050155776:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788839692.998529:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998549:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998560:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998612:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998619:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998625:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998632:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839692.998636:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998643:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998655:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839692.998659:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839692.998663:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839692.998670:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a2657308c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839692.999938:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+56:11275:x1875734050155776:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 12891us (13266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839692.999952:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1788839693.005245:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839693.005350:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050156032 00000100:00100000:1.0:1788839693.005360:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050156032 00000100:00100000:1.0:1788839693.005420:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788839693.005431:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+56:11275:x1875734050156032:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839693.005667:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+57:11275:x1875734050156032:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 238us (430us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788839693.005675:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00010000:00010000:3.0:1788839693.118980:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839693.175467:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839693.175748:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050156288 00000100:00100000:3.0:1788839693.175760:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050156288 00000100:00100000:3.0:1788839693.175869:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1788839693.175880:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+57:11293:x1875734050156288:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788839693.175904:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839693.175929:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573093 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748c5 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.176046:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657309a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.176073:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657309a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.176084:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657309a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839693.176096:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788839693.176214:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573093 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748c5 expref: 60 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.176234:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657309a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748c5 expref: 59 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.176243:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839693.176247:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788839693.176250:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7c00, rc 0) 00000100:00100000:3.0:1788839693.176335:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11293:x1875734050156288:12345-192.168.203.52@tcp:101:cat.0 Request processed in 456us (877us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788839693.176359:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1788839693.223282:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839693.223420:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050156416 00000100:00100000:0.0:1788839693.223430:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050156416 00000100:00100000:0.0:1788839693.223494:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1788839693.223504:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11294:x1875734050156416:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839693.223529:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839693.223549:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748cc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.223617:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265730af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.223632:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265730af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.223643:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265730af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839693.223683:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788839693.223698:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839693.223718:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265730af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.223760:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748cc expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.223830:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265730af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748cc expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.223840:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839693.223844:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839693.223847:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc800, rc 0) 00000100:00100000:0.0:1788839693.223904:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11294:x1875734050156416:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 402us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839693.223911:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1788839693.230616:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839693.230699:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050156800 00000100:00100000:3.0:1788839693.230709:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050156800 00000100:00100000:3.0:1788839693.230806:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1788839693.230817:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11294:x1875734050156800:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839693.231094:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11294:x1875734050156800:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 279us (487us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788839693.231103:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788839693.235430:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839693.235522:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050156928 00000100:00100000:3.0:1788839693.235532:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050156928 00000100:00100000:3.0:1788839693.235602:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788839693.235612:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11294:x1875734050156928:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1788839693.235627:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788839693.235654:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657303f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748b0 expref: 61 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.235678:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657309a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748c5 expref: 60 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.235692:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26572f3c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7486a expref: 59 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.235703:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839693.235708:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839693.235857:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+58:11294:x1875734050156928:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 245us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839693.235881:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788839693.247701:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839693.247924:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050157056 00000100:00100000:0.0:1788839693.247935:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050157056 00000100:00100000:0.0:1788839693.247994:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788839693.248005:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+58:11294:x1875734050157056:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1788839693.248128:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.248147:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.248159:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839693.248397:0:7438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839693.248546:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788839693.248637:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788839693.248880:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+58:11294:x1875734050157056:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 873us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839693.248889:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:2.0:1788839693.295310:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839693.295562:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050157184 00000100:00100000:0.0:1788839693.295573:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050157184 00000100:00100000:0.0:1788839693.295640:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:0.0:1788839693.295651:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+58:11296:x1875734050157184:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839693.295672:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839693.295693:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265730bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748d3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.295804:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.295830:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.295845:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.295856:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.295864:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.295871:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296134:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296145:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296152:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839693.296209:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788839693.296213:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839693.296232:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296243:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296252:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296258:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296264:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296270:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839693.296274:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296281:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296460:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839693.296463:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839693.296468:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296474:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265730c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296488:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296494:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296500:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296505:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839693.296508:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296515:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296521:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:0.0:1788839693.296524:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839693.296527:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296533:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd000/0xad5b343a265730cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296573:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265730bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 60 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296587:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 59 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839693.296594:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:0.0:1788839693.296597:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839693.296600:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd200, rc 0) 00000100:00100000:0.0:1788839693.296714:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11296:x1875734050157184:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1065us (1413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839693.296722:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788839693.695058:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060726784:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839693.695134:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839693.695209:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060726784 00000100:00100000:3.0:1788839693.695226:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060726784 00000100:00100000:3.0:1788839693.695288:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788839693.695298:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060726784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839693.695328:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839693.701480:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060726784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 6173us (6336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839693.701495:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788839693.703418:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060726784:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788839693.958309:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839693.958320:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839693.958361:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788839693.958382:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788839693.958513:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060726912:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788839693.958611:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6419b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839693.964866:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060726912:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839693.966542:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839693.967083:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050157312 00000100:00100000:1.0:1788839693.967094:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050157312 00000100:00100000:1.0:1788839693.967152:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1788839693.967161:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11307:x1875734050157312:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839693.967280:0:6489:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839693.967414:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11307:x1875734050157312:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 253us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839693.967423:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000001:00080000:1.0:1788839693.976071:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:1.0:1788839693.976124:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1788839693.976140:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab745c04cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1788839693.976144:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab646879900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab7416680c0 00000020:00080000:1.0:1788839693.976147:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab646879600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab646869c00 00010000:00010000:3.0:1788839693.976258:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976271:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976279:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976284:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.976289:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976297:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976311:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab647851e00) 00010000:00010000:3.0:1788839693.976314:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.976318:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976335:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26572e78 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976352:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976358:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976363:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976367:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.976369:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976374:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976380:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839693.976383:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.976385:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976391:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26572e7f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976405:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976409:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976419:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976424:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.976426:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976431:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976438:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad1100) 00010000:00010000:3.0:1788839693.976440:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.976443:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976448:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26572ebe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976460:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976465:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976469:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976473:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.976476:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976488:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976495:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839693.976497:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.976499:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976504:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26572fc8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976514:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976519:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976524:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976528:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.976530:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976535:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976540:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839693.976541:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.976543:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976556:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26572feb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976565:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976570:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976574:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976579:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.976581:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976586:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976592:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839693.976594:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.976596:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.976601:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573031 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788839693.976703:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788839693.976892:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788839693.976903:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839693.976922:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060727040:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788839693.977010:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839693.977059:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060727040 00000100:00100000:3.0:1788839693.977067:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060727040 00000100:00100000:3.0:1788839693.977119:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839693.977127:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060727040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788839693.977151:0:8538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788839693.977181:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f870a, atime: 0x6a9f870a, ctime: 0x6a9f870a, blocks: 0x8 00010000:00010000:3.0:1788839693.977188:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977204:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1788839693.977208:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839693.977215:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977232:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977241:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977249:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977265:0:8538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839693.977380:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060727040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 253us (369us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788839693.977396:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788839693.977418:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839693.977430:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839693.977436:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977444:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839693.977447:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977455:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977468:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977475:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faaf0f04/0xad5b343a265730d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.977491:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839693.977493:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839693.977494:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788839693.977525:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab6480f7b80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788839693.977531:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060727040:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788839693.979157:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839693.979759:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050157440 00000100:00100000:3.0:1788839693.979793:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050157440 00000100:00100000:3.0:1788839693.979861:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1788839693.979871:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+12:11307:x1875734050157440:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788839693.979944:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.979961:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.979987:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980021:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980029:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980036:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980066:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980076:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980083:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839693.980137:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788839693.980142:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839693.980156:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980177:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980183:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980191:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980197:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.980202:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980211:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980225:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:3.0:1788839693.980228:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.980232:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980239:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265730e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980252:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980259:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980264:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980274:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.980277:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980283:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980293:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8ab647851100) 00010000:00010000:3.0:1788839693.980295:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.980298:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980304:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265730e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980335:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980341:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980347:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980353:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839693.980356:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980362:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980408:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839693.980411:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839693.980415:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839693.980421:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265730ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839693.980497:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+12:11307:x1875734050157440:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 627us (1345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839693.980505:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1788839693.988153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839693.988519:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050157696 00000100:00100000:2.0:1788839693.988528:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050157696 00000100:00100000:2.0:1788839693.988576:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788839693.988584:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+12:11307:x1875734050157696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839693.988603:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839693.988622:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265730f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748da expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988716:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988738:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988749:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839693.988759:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788839693.988846:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988854:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988861:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988876:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839693.988881:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988889:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988902:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:2.0:1788839693.988905:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839693.988910:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988916:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a265730fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988957:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265730f5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748da expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988979:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839693.988982:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839693.988986:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265730f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748da expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839693.988996:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843c00, rc 0) 00000100:00100000:2.0:1788839693.989054:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11307:x1875734050157696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 470us (911us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788839693.989061:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:1.0:1788839694.001131:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.001216:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050157824 00000100:00100000:0.0:1788839694.001225:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050157824 00000100:00100000:0.0:1788839694.001297:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1788839694.001307:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11307:x1875734050157824:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788839694.001343:0:7438:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788839694.001448:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11307:x1875734050157824:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 142us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.001455:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00080000:3.0:1788839694.001503:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839694.009055:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.009158:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050158080 00000100:00100000:1.0:1788839694.009171:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050158080 00000100:00100000:1.0:1788839694.009236:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1788839694.009246:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11307:x1875734050158080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839694.009267:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839694.009270:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788839694.009297:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265730af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748cc expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.009314:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:1.0:1788839694.009319:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839694.009332:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657310a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748e1 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788839694.009749:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788839694.009921:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573111 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.009934:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.009944:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573111 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.010140:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657310a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e1 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.010156:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573111 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e1 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.010164:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab7750ce100) 00010000:00010000:1.0:1788839694.010167:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839694.010170:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959200, rc 0) 00000100:00100000:1.0:1788839694.010237:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050158080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 992us (1191us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788839694.010244:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000040:00080000:0.0:1788839694.015675:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788839694.018122:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.019083:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050158336 00000100:00100000:0.0:1788839694.019095:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050158336 00000100:00100000:0.0:1788839694.019159:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1788839694.019169:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050158336:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839694.019229:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839694.019260:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573111 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e1 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019279:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab7750ce100) 00010000:00010000:0.0:1788839694.019291:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839694.019314:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019328:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019339:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019399:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019407:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019414:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019458:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019466:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019483:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019489:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.019493:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019501:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019510:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839694.019513:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839694.019517:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019523:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a2657311f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019533:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019539:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019545:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019551:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.019554:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019569:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019577:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xf89bb8aa (ffff8ab777ad1e00) 00010000:00010000:0.0:1788839694.019579:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839694.019582:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.019588:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573126 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xf89bb8aa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.019675:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11307:x1875734050158336:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 506us (1561us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839694.019682:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1788839694.028157:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.028224:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050158464 00000100:00100000:3.0:1788839694.028233:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050158464 00000100:00100000:3.0:1788839694.028288:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1788839694.028297:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11307:x1875734050158464:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839694.028315:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839694.028334:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657312d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748e8 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.028366:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.028378:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.028388:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.028686:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657312d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 15 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.028704:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 14 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.028719:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:3.0:1788839694.028722:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839694.028732:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078a00, rc 0) 00000100:00100000:3.0:1788839694.029308:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050158464:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1010us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.029317:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1788839694.032689:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.032836:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050158720 00000100:00100000:2.0:1788839694.032847:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050158720 00000100:00100000:2.0:1788839694.032911:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1788839694.032921:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050158720:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839694.033020:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.033038:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.033049:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839694.033200:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788839694.033209:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348977437544ns, next at 349977435602ns, rc = 0 00000004:00010000:2.0:1788839694.033253:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c963bdd0 reply state 00000000cfc941b5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.033265:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.033272:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.033275:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788839694.033279:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839694.033364:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11307:x1875734050158720:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 444us (685us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788839694.033371:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:1.0:1788839694.036544:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.036639:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050158848 00000100:00100000:0.0:1788839694.036649:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050158848 00000100:00100000:0.0:1788839694.036709:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1788839694.036736:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11307:x1875734050158848:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839694.036760:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839694.036821:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748ef expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.037046:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 17 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.037063:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 17 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.037103:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:0.0:1788839694.037106:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839694.037109:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc600, rc 0) 00000100:00100000:0.0:1788839694.037162:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+17:11307:x1875734050158848:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 444us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.037171:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:1.0:1788839694.040264:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.040347:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050158976 00000100:00100000:2.0:1788839694.040356:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050158976 00000100:00100000:2.0:1788839694.040402:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1788839694.040410:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1875734050158976:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788839694.040460:0:8539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1788839694.040498:0:8539:0:(genops.c:1385:class_connect()) connect: client 4c22f38d-5944-4459-a83e-bcbd490346fb, cookie 0xad5b343a26573149 00002000:00100000:2.0:1788839694.040509:0:8539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4c22f38d-5944-4459-a83e-bcbd490346fb/ffff8ab64809f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788839694.040527:0:8539:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type b7, return b7 00002000:00080000:2.0:1788839694.040603:0:8539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788839694.040632:0:8539:0:(import.c:65:import_set_state_nolock()) ffff8ab64809c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839694.040697:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2388:x1875734050158976:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 Request processed in 287us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839694.040705:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788839694.043867:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.044151:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050159104 00000100:00100000:1.0:1788839694.044176:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050159104 00000100:00100000:1.0:1788839694.044244:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788839694.044255:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:0:x1875734050159104:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788839694.044530:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788839694.056154:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:2.0:1788839694.056169:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000100:00100000:1.0:1788839694.056346:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:0:x1875734050159104:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 12088us (12485us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788839694.056356:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1788839694.060110:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.060195:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050159360 00000100:00100000:3.0:1788839694.060205:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050159360 00000100:00100000:3.0:1788839694.060263:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788839694.060273:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+17:11307:x1875734050159360:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788839694.060492:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11307:x1875734050159360:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 220us (390us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788839694.060500:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788839694.065143:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.066010:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050159616 00000100:00100000:3.0:1788839694.066023:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050159616 00000100:00100000:3.0:1788839694.066089:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1788839694.066100:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11307:x1875734050159616:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788839694.066239:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11307:x1875734050159616:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 140us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.066248:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1788839694.070442:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.070502:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050159744 00000100:00100000:0.0:1788839694.070518:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050159744 00000100:00100000:0.0:1788839694.070586:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:0.0:1788839694.070600:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11307:x1875734050159744:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839694.070629:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839694.070651:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748f6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.070751:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.070765:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.070809:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839694.070853:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839694.070879:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.070909:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748f6 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.070935:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748f6 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.070945:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:0.0:1788839694.070948:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788839694.070951:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfcc00, rc 0) 00000100:00100000:0.0:1788839694.071034:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11307:x1875734050159744:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 440us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.071045:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1788839694.074097:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.074306:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050159872 00000100:00100000:3.0:1788839694.074315:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050159872 00000100:00100000:3.0:1788839694.074364:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788839694.074373:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050159872:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839694.074389:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839694.074416:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e748fd expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839694.074441:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f870d, blocks: 0x0 00010000:00010000:3.0:1788839694.074458:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:3.0:1788839694.074462:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839694.074471:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 6 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.074490:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 6 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.074504:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079200, rc 0) 00000100:00100000:3.0:1788839694.075464:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64797a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050159872:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1087us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.075473:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788839694.081419:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.086572:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050160128 00000100:00100000:1.0:1788839694.086586:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050160128 00000100:00100000:1.0:1788839694.088241:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1788839694.088266:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11307:x1875734050160128:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839694.088390:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11307:x1875734050160128:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 136us (6979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839694.088399:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:3.0:1788839694.091283:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.091414:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050160256 00000100:00100000:1.0:1788839694.091424:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050160256 00000100:00100000:1.0:1788839694.091478:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788839694.091488:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:11307:x1875734050160256:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839694.091505:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839694.091525:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74904 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.091552:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.091561:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839694.091575:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839694.091581:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.091613:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 7 pid: 8404 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.091739:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 7 pid: 8404 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839694.091754:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875734060727168:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839694.092227:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839694.094065:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.094122:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050160384 00000100:00100000:0.0:1788839694.094129:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050160384 00010000:00010000:0.0:1788839694.094165:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 8 pid: 8404 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.094204:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788839694.094212:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050160384:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839694.094226:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839694.094244:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 8 pid: 8404 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.094255:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 8 pid: 8404 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.094277:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839694.094289:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839694.094297:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.094306:0:10307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.094338:0:10307:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.094352:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10307:1875734060727296:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788839694.094412:0:10307:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e03c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788839694.095196:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d00a4c7/0xad5b343a2657315e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748fd expref: 8 pid: 8404 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839694.095212:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875734060727168:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839694.095234:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.095244:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958600, rc 0) 00000100:00100000:1.0:1788839694.095292:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11307:x1875734050160256:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3806us (4018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839694.095300:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1788839694.097318:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10307:1875734060727296:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788839694.097347:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839694.097411:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050160384:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 3199us (3352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839694.097421:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788839694.103739:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.105982:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050160512 00000100:00100000:2.0:1788839694.105995:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050160512 00002000:00100000:2.0:1788839694.106046:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ab781a19500 x1875734050160512/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:85/0 lens 504/0 e 0 to 0 dl 1788839705 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839694.106058:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab781a19500 with x1875734050160512 ext(0->8) 00002000:00010000:2.0:1788839694.106063:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab781a19500 00000100:00100000:2.0:1788839694.106085:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788839694.106093:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050160512:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788839694.109532:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050160512:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 3428us (5809us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788839694.109547:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:2.0:1788839694.109571:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8ab781a19500 x1875734050160512/t4294967303(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:85/0 lens 504/448 e 0 to 0 dl 1788839705 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839694.109582:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab781a19500 with x1875734050160512 ext(0->8) 00002000:00010000:2.0:1788839694.109588:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab781a19500 00000100:00100000:2.0:1788839694.114416:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.114462:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050160640 00000100:00100000:0.0:1788839694.114472:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050160640 00000100:00100000:0.0:1788839694.114538:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1788839694.114549:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11307:x1875734050160640:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788839694.117532:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788839694.117548:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788839694.117565:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:2.0:1788839694.117638:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.117650:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.117659:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.117665:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.117670:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.117678:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.117695:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.117698:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788839694.117703:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.117709:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657313b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788839694.117848:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788839694.117860:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788839694.117970:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839694.117988:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060727424:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788839694.118061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839694.118101:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050160640:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 3553us (3694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.118112:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1788839694.118118:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060727424 00000100:00100000:1.0:1788839694.118124:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060727424 00000100:00100000:1.0:1788839694.118171:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839694.118181:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060727424:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788839694.118296:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788839694.118299:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788839693 00002000:00010000:1.0:1788839694.118302:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788839694.118304:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788839693 -> 1788839693 00002000:00010000:1.0:1788839694.118306:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788839694.119295:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060727424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1113us (1230us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788839694.119305:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788839694.119329:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788839694.119382:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab781a19c00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788839694.119388:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060727424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788839694.125434:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.125765:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050160768 00000100:00100000:1.0:1788839694.125800:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050160768 00000100:00100000:1.0:1788839694.125849:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1788839694.125860:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050160768:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788839694.129910:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788839694.129925:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788839694.131273:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050160768:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 5407us (5840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.131304:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1788839694.135583:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.136158:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050161024 00000100:00100000:2.0:1788839694.136168:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050161024 00000100:00100000:2.0:1788839694.136218:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:2.0:1788839694.136228:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050161024:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839694.136281:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839694.136306:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748f6 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.136323:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.136328:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839694.136359:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.136374:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.136384:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839694.136508:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb37ce9c reply state 0000000053b90e48 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.136520:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.136526:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.136537:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839694.136541:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839694.136637:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+15:11307:x1875734050161024:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 410us (1064us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788839694.136644:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:3.0:1788839694.140427:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.140486:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050161152 00000100:00100000:1.0:1788839694.140496:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050161152 00000100:00100000:1.0:1788839694.140556:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1788839694.140565:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050161152:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788839694.140743:0:8403:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788839694.140752:0:8403:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788839693 -> 1788839692 00002000:00010000:1.0:1788839694.140755:0:8403:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788839690 00002000:00010000:1.0:1788839694.140757:0:8403:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788839693 -> 1788839692 00002000:00010000:1.0:1788839694.140760:0:8403:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788839694.140849:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050161152:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 284us (432us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788839694.140856:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1788839694.143276:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.143321:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050161408 00000100:00100000:1.0:1788839694.143330:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050161408 00000100:00100000:1.0:1788839694.143420:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:1.0:1788839694.143430:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+15:11307:x1875734050161408:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788839694.143488:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.143505:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 15 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.143515:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.143547:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 15 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.143561:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 15 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839694.143576:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060727552:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839694.143659:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae900 going to sleep for 11 seconds 00010000:00010000:3.0:1788839694.149606:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839694.150402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.150470:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050161536 00000100:00100000:3.0:1788839694.150478:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050161536 00010000:00010000:3.0:1788839694.150515:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 16 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839694.150558:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788839694.150568:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:2389:x1875734050161536:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839694.150582:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839694.150588:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 16 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.150600:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 16 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.150631:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:3.0:1788839694.150637:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.150647:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.150655:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.150679:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839694.150750:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:2389:x1875734050161536:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 183us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.150758:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00010000:00010000:2.0:1788839694.151408:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573134 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748e8 expref: 15 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.151425:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060727552:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839694.151446:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151455:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151461:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151497:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151504:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151511:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151517:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.151521:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151539:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151549:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.151552:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788839694.151556:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.151561:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573173 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.151659:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050161408:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 8231us (8391us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788839694.151668:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788839694.158138:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.162912:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050161664 00000100:00100000:2.0:1788839694.162929:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050161664 00000100:00100000:2.0:1788839694.163002:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788839694.163013:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050161664:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788839694.163059:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.163078:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.163085:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839694.163090:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839694.163094:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.163145:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.163159:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 7 pid: 8403 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.163172:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8539:1875734060727680:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839694.163261:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839694.166581:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.166714:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8539:1875734060727680:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839694.166750:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.167052:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050161792 00000100:00100000:0.0:1788839694.167059:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050161792 00010000:00010000:0.0:1788839694.167094:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.167135:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788839694.167145:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050161792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839694.167160:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839694.167181:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.167195:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.167216:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cd3fbc9/0xad5b343a26573165 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74904 expref: 8 pid: 8403 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.167231:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839694.167235:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839694.167241:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.167250:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.167284:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839694.167333:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050161792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 189us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.167341:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00010000:00010000:2.0:1788839694.170239:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.170262:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171060:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171077:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171103:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171110:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839694.171114:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171123:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171145:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.171153:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002302453e/0xad5b343a2657317a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.171293:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050161664:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 8275us (13157us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839694.171303:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788839694.182846:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.183031:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050162048 00000100:00100000:0.0:1788839694.183041:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050162048 00000100:00100000:0.0:1788839694.183236:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:0.0:1788839694.183250:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11307:x1875734050162048:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788839694.183333:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.183350:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.183359:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.183391:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.183405:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 14 pid: 6488 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.183419:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060727808:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839694.183493:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839694.188688:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.188956:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050162176 00000100:00100000:3.0:1788839694.189033:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050162176 00010000:00010000:3.0:1788839694.189074:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 15 pid: 6488 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839694.189105:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1788839694.189116:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+15:2389:x1875734050162176:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839694.189130:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839694.189137:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 15 pid: 6488 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.189151:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 15 pid: 6488 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.189174:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839694.189180:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.189191:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.189214:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.189232:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839694.189278:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+15:2389:x1875734050162176:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 165us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.189286:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00010000:00010000:2.0:1788839694.191863:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26572fc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7488d expref: 14 pid: 6488 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.191887:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060727808:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839694.191911:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.191926:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.191932:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.192124:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.192138:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 14 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.192147:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.192179:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 14 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.192194:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 14 pid: 7438 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.192208:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060727936:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839694.192291:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839694.198245:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.198276:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050162304 00000100:00100000:2.0:1788839694.198283:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050162304 00010000:00010000:2.0:1788839694.198320:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 15 pid: 7438 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.198364:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1788839694.198374:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+15:2389:x1875734050162304:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839694.198387:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839694.198394:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 15 pid: 7438 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.198407:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 15 pid: 7438 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.198429:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.198434:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.198444:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.198452:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.198468:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839694.198511:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+15:2389:x1875734050162304:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 138us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839694.198518:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00010000:00010000:1.0:1788839694.199584:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573142 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748ef expref: 14 pid: 7438 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839694.199603:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060727936:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839694.199626:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.199635:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.199640:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839694.199756:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788839694.199897:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788839694.199934:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788839694.200091:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6489:1875734060728064:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788839694.200144:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839694.200174:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748249840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839694.200287:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060728064 00000100:00100000:0.0:1788839694.200298:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060728064 00000100:00100000:0.0:1788839694.200348:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788839694.200356:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6489:x1875734060728064:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788839694.200435:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6489:x1875734060728064:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.200441:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788839694.200471:0:6489:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788839694.200476:0:6489:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab781a19c00, transno 4294967304 00000100:00100000:0.0:1788839694.200493:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6489:1875734060728064:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788839694.200595:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788839694.200634:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6489:1875734060728192:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788839694.200660:0:6489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839694.200678:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839694.200923:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060728192 00000100:00100000:3.0:1788839694.200928:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060728192 00000100:00100000:3.0:1788839694.200953:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788839694.200959:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6489:x1875734060728192:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788839694.201053:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6489:x1875734060728192:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (392us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788839694.201060:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788839694.201089:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6489:1875734060728192:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788839694.201118:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201127:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201135:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201140:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.201144:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201163:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201177:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:3.0:1788839694.201180:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839694.201184:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201190:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573188 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201214:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201220:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201226:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201232:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfce00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.201234:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201240:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201247:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839694.201249:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839694.201252:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201266:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265730b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201287:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201300:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201309:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201331:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.201343:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 17 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839694.201353:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060728320:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839694.201404:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839694.207135:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060728320:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839694.207164:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839694.211568:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.222877:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050162432 00000100:00100000:3.0:1788839694.222892:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050162432 00010000:00010000:3.0:1788839694.222940:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 18 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839694.222982:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1788839694.222992:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2390:x1875734050162432:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839694.223007:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839694.223024:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 18 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.223038:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 18 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.223059:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265730d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e748d3 expref: 18 pid: 6487 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.223072:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:3.0:1788839694.223077:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.223086:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.223092:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.223113:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839694.223169:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+17:2390:x1875734050162432:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 179us (11614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.223175:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00010000:00010000:0.0:1788839694.223801:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223811:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223823:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223830:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223847:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223853:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.223856:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223863:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223872:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:0.0:1788839694.223875:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839694.223879:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223885:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a2657318f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223897:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223902:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223907:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223912:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.223914:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223929:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223937:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851700) 00010000:00010000:0.0:1788839694.223939:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839694.223942:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.223947:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573181 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.224088:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11307:x1875734050162048:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 40841us (41251us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788839694.224096:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000020:00080000:0.0:1788839694.224100:0:6489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788839694.224225:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839694.224230:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839694.224245:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788839694.224251:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839694.230941:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.234650:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050162688 00000100:00100000:3.0:1788839694.234666:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050162688 00000100:00100000:0.0:1788839694.239823:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788839694.239840:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11307:x1875734050162688:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788839694.240096:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788839694.240130:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788839694.240168:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.240187:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.240198:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.240219:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.240227:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.240233:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.240259:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788839694.240347:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11307:x1875734050162688:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 511us (9414us total) trans 4294967364 rc 0/0 00010000:00010000:2.0:1788839694.240389:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839694.240397:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.240406:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839694.240416:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.240426:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.240439:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:2.0:1788839694.240443:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788839694.240447:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.240455:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a26573196 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.240465:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839694.240467:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839694.240468:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839694.244804:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000020:00080000:0.0:1788839694.244815:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788839694.246951:0:14177:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839694.246959:0:14177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839694.246991:0:14177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788839694.246997:0:14177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839694.372570:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.372665:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050162944 00000100:00100000:2.0:1788839694.372675:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050162944 00000100:00100000:2.0:1788839694.372750:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:2.0:1788839694.372762:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:11317:x1875734050162944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839694.372820:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839694.372842:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657319d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7490b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.372951:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a265731a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.372967:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a265731a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.372978:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a265731a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839694.372997:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788839694.373100:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657319d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7490b expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.373119:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a265731a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7490b expref: 20 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.373128:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839694.373131:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839694.373134:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842a00, rc 0) 00000100:00100000:2.0:1788839694.373191:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+20:11317:x1875734050162944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 433us (631us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788839694.373198:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:2.0:1788839694.380564:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.380719:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050163072 00000100:00100000:0.0:1788839694.380736:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050163072 00000100:00100000:0.0:1788839694.380817:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1788839694.380828:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+20:11317:x1875734050163072:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788839694.380913:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.380931:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.380943:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.380969:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.380977:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.380984:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381065:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381073:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381080:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839694.381125:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381140:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381146:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381152:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381157:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfcc00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.381161:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381174:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381185:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839694.381188:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839694.381192:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381198:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265731b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381209:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381214:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381219:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381223:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfca00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.381226:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381230:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381236:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab777ad0400) 00010000:00010000:0.0:1788839694.381238:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839694.381240:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381254:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265731b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381268:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381273:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381278:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381283:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.381285:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381290:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381297:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839694.381299:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839694.381302:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.381308:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.381397:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+20:11317:x1875734050163072:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 570us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.381406:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1788839694.448921:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.449321:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050163328 00000100:00100000:0.0:1788839694.449331:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050163328 00000100:00100000:3.0:1788839694.449455:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:3.0:1788839694.449466:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+20:11320:x1875734050163328:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839694.449488:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839694.449509:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a265731c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74912 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449583:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449701:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449715:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449740:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449749:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449756:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449905:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449914:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.449922:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839694.449945:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788839694.450025:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450033:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450040:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450047:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.450052:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450385:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450399:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839694.450402:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839694.450407:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450413:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a265731ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450427:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450434:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450451:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450456:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.450460:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450467:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450475:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:3.0:1788839694.450478:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839694.450480:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450486:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a265731d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450531:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a265731c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450546:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.450554:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.450556:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839694.450558:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078200, rc 0) 00000100:00100000:3.0:1788839694.450642:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11320:x1875734050163328:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1177us (1727us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788839694.450660:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:3.0:1788839694.459901:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.460054:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050163456 00000100:00100000:0.0:1788839694.460064:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050163456 00000100:00100000:0.0:1788839694.460129:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:0.0:1788839694.460139:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11320:x1875734050163456:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788839694.460206:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460229:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460241:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460276:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460283:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460289:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460294:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839694.460298:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460305:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460317:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:0.0:1788839694.460332:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839694.460338:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.460344:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265731ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.460421:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747798380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11320:x1875734050163456:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 283us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.460429:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:2.0:1788839694.471489:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.471697:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050163712 00000100:00100000:3.0:1788839694.471709:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050163712 00000100:00100000:2.0:1788839694.472013:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788839694.472023:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11320:x1875734050163712:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839694.472266:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+23:11320:x1875734050163712:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 243us (785us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788839694.472275:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788839694.531889:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.531984:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050163968 00000100:00100000:2.0:1788839694.531995:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050163968 00000100:00100000:2.0:1788839694.532074:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:2.0:1788839694.532086:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+23:10846:x1875734050163968:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839694.532113:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839694.532149:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265731f1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74919 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.532263:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.532278:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.532287:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.532331:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.532345:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 24 pid: 6489 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.532357:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060728448:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839694.532468:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839694.542568:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060728448:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839694.542607:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839694.542702:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.542808:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164096 00000100:00100000:1.0:1788839694.542814:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164096 00010000:00010000:1.0:1788839694.542851:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 25 pid: 6489 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839694.542894:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788839694.542904:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+25:2390:x1875734050164096:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839694.542933:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839694.542941:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 25 pid: 6489 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.542953:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 25 pid: 6489 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.542975:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a265731dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74912 expref: 25 pid: 6489 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.542991:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:1.0:1788839694.542995:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.543005:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.543013:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.543051:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839694.543101:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+24:2390:x1875734050164096:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 198us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839694.543109:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:3.0:1788839694.543257:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.543265:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839694.543281:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788839694.543466:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265731f1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 25 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.543481:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 24 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.543489:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.543492:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788839694.543494:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:3.0:1788839694.543521:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+24:10846:x1875734050163968:12345-192.168.203.52@tcp:101:bash.0 Request processed in 11439us (11645us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788839694.543527:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788839694.546127:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.546203:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164224 00000100:00100000:3.0:1788839694.546212:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164224 00000100:00100000:3.0:1788839694.546269:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:3.0:1788839694.546291:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+24:10846:x1875734050164224:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839694.546325:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839694.546345:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573206 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74920 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.546387:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657320d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.546400:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657320d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.546410:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657320d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.546513:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573206 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74920 expref: 26 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.546531:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657320d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74920 expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.546540:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.546542:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839694.546546:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079200, rc 0) 00000100:00100000:3.0:1788839694.546604:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+25:10846:x1875734050164224:12345-192.168.203.52@tcp:101:bash.0 Request processed in 315us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.546612:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:0.0:1788839694.550197:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.553021:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164480 00000100:00100000:2.0:1788839694.553039:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164480 00000100:00100000:2.0:1788839694.553118:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1788839694.553128:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+25:10846:x1875734050164480:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788839694.553375:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.553403:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.553414:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839694.553459:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:2.0:1788839694.553483:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008d22d59e reply state 00000000e1de6541 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.553496:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.553503:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:2.0:1788839694.553505:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839694.553509:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788839694.553546:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:2.0:1788839694.553644:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+29:10846:x1875734050164480:12345-192.168.203.52@tcp:36:bash.0 Request processed in 516us (3454us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788839694.553653:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000020:00080000:2.0:1788839694.553657:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788839694.556143:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.556217:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164608 00000100:00100000:3.0:1788839694.556226:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164608 00000100:00100000:3.0:1788839694.556276:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:3.0:1788839694.556387:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+29:10846:x1875734050164608:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839694.556410:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839694.556430:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657321b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74927 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.556487:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657321b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74927 expref: 30 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.556501:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657321b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74927 expref: 30 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.556518:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.556521:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839694.556524:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078a00, rc 0) 00000100:00100000:3.0:1788839694.556574:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+30:10846:x1875734050164608:12345-192.168.203.52@tcp:101:bash.0 Request processed in 282us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.556582:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:0.0:1788839694.563185:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839694.563520:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164736 00000100:00100000:1.0:1788839694.563531:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164736 00000100:00100000:1.0:1788839694.563628:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1788839694.563639:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:10846:x1875734050164736:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839694.563672:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839694.563693:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7492e expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839694.563822:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f870c, atime: 0x6a9f870a, ctime: 0x6a9f870c, blocks: 0x8 00010000:00010000:1.0:1788839694.563846:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1788839694.563850:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839694.563860:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.563949:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839694.563963:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959200, rc 0) 00000100:00100000:1.0:1788839694.564026:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:10846:x1875734050164736:12345-192.168.203.52@tcp:101:bash.0 Request processed in 388us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839694.564033:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:3.0:1788839694.565858:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.566090:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164864 00000100:00100000:2.0:1788839694.566099:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164864 00002000:00010000:2.0:1788839694.566142:0:8408:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788839694.566147:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab777eeca80 with x1875734050164864 ext(0->18446744073709551615) 00002000:00010000:2.0:1788839694.566159:0:8408:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab777eeca80. 00000100:00100000:2.0:1788839694.566193:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788839694.566203:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2391:x1875734050164864:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:2.0:1788839694.566483:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788839694.566496:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788839692 -> 1788839693 00002000:00010000:2.0:1788839694.566498:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788839690 -> 1788839690 00002000:00010000:2.0:1788839694.566501:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788839692 -> 1788839693 00002000:00010000:2.0:1788839694.566503:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788839694.566557:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2391:x1875734050164864:12345-192.168.203.52@tcp:10:bash.0 Request processed in 355us (717us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788839694.566565:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00010000:2.0:1788839694.566568:0:8408:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788839694.566571:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab777eeca80 with x1875734050164864 ext(0->18446744073709551615) 00002000:00010000:2.0:1788839694.566575:0:8408:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab777eeca80. 00000100:00100000:3.0:1788839694.672261:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.672615:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050164992 00000100:00100000:2.0:1788839694.672626:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050164992 00000100:00100000:2.0:1788839694.672690:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:2.0:1788839694.672701:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11334:x1875734050164992:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1788839694.673095:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673116:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673127:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673143:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673150:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673157:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673246:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673256:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673263:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839694.673323:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673335:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673341:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673348:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673353:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.673358:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673377:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673460:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839694.673464:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839694.673469:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673483:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573229 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673496:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673502:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673507:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673512:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.673515:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673521:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673528:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab646801000) 00010000:00010000:2.0:1788839694.673530:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839694.673533:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673539:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573230 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673552:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673558:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673568:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673572:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.673575:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673580:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673586:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:2.0:1788839694.673588:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839694.673591:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.673660:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573237 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.674097:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11334:x1875734050164992:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1392us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839694.674107:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:2.0:1788839694.724929:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.725085:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050165248 00000100:00100000:3.0:1788839694.725096:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050165248 00000100:00100000:3.0:1788839694.725161:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:3.0:1788839694.725172:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11337:x1875734050165248:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839694.725195:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839694.725218:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657323e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74935 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725329:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725345:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725356:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725370:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725378:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725395:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725496:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573253 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725506:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725513:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573253 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839694.725522:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788839694.725611:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725619:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725632:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725638:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.725642:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725650:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725663:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839694.725666:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839694.725671:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725678:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573245 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725692:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725699:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725704:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725709:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.725712:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725739:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725748:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:3.0:1788839694.725750:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839694.725753:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725759:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657324c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725852:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657323e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74935 expref: 33 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.725866:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573253 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74935 expref: 32 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.726112:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.726115:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788839694.726118:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7800, rc 0) 00000100:00100000:3.0:1788839694.726190:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11337:x1875734050165248:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1018us (1270us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788839694.726198:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:3.0:1788839694.729054:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.729140:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050165376 00000100:00100000:2.0:1788839694.729150:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050165376 00000100:00100000:2.0:1788839694.729209:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:2.0:1788839694.729219:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11337:x1875734050165376:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788839694.729287:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.729333:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 32 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.729344:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.729378:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 32 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.729513:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 32 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.729528:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060728576:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839694.729631:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839694.733846:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060728576:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839694.733888:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839694.734279:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.734736:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050165632 00000100:00100000:0.0:1788839694.734745:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050165632 00000100:00100000:0.0:1788839694.734849:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788839694.734860:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+33:6162:x1875734050165632:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788839694.735136:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+34:6162:x1875734050165632:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 277us (857us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788839694.735144:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788839694.748640:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.748790:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050165760 00000100:00100000:2.0:1788839694.748800:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050165760 00010000:00010000:2.0:1788839694.748856:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 34 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839694.749015:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788839694.749026:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+34:2389:x1875734050165760:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839694.749044:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839694.749065:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 34 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.749080:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 34 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.749102:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265731f8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74919 expref: 34 pid: 12241 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.749119:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:2.0:1788839694.749123:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.749133:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.749141:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.749168:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839694.749292:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749309:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749348:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749365:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749372:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749378:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842000 already unused, calling callback (ffffffffc19974f0) 00000100:00100000:2.0:1788839694.749502:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+33:2389:x1875734050165760:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 477us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839694.749511:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00010000:00010000:0.0:1788839694.749667:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749676:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749688:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:0.0:1788839694.749690:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839694.749694:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.749700:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a26573261 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839694.749766:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11337:x1875734050165376:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 20548us (20721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839694.749815:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:3.0:1788839694.764317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.764452:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050166016 00000100:00100000:0.0:1788839694.764462:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050166016 00000100:00100000:0.0:1788839694.764521:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839694.764531:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+32:11337:x1875734050166016:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839694.765121:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+33:11337:x1875734050166016:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 587us (810us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788839694.765142:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788839694.851221:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.851320:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050166272 00000100:00100000:2.0:1788839694.851330:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050166272 00000100:00100000:2.0:1788839694.851539:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:2.0:1788839694.851550:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+33:11348:x1875734050166272:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788839694.851575:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839694.851596:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573268 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7493c expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.851681:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.851696:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.851707:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.851731:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.851739:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.851746:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852054:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657327d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852064:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657327d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852071:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657327d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839694.852081:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788839694.852153:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852160:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852172:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852178:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.852182:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852190:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852202:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839694.852205:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839694.852209:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852215:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657326f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852229:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852235:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852241:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852246:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.852248:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852263:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852272:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab646801000) 00010000:00010000:2.0:1788839694.852274:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839694.852276:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852282:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573276 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852467:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573268 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7493c expref: 36 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852482:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657327d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7493c expref: 35 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.852489:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:2.0:1788839694.852492:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839694.852494:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839694.852612:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11348:x1875734050166272:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1063us (1398us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788839694.852620:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:3.0:1788839694.863732:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.863831:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050166528 00000100:00100000:2.0:1788839694.863841:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050166528 00000100:00100000:2.0:1788839694.863891:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1788839694.863901:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11348:x1875734050166528:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:2.0:1788839694.864204:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+36:11348:x1875734050166528:12345-192.168.203.52@tcp:35:cat.0 Request processed in 303us (499us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788839694.864212:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788839694.897118:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839694.897223:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050166784 00000100:00100000:3.0:1788839694.897244:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050166784 00000100:00100000:3.0:1788839694.897397:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:3.0:1788839694.897408:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+36:11349:x1875734050166784:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1788839694.897465:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788839694.897492:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657321b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74927 expref: 36 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897514:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657327d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7493c expref: 35 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897526:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573253 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74935 expref: 34 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897536:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657320d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74920 expref: 33 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897546:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.897550:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839694.897571:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897583:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897592:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897605:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897622:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897629:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897702:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897711:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.897718:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839694.898169:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00010000:00010000:3.0:1788839694.898650:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898661:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898669:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898677:0:6489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898683:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898690:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898805:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839694.898824:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898830:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898835:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898841:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.898846:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898853:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898863:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839694.898866:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788839694.898870:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898876:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573299 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898893:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898898:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898903:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898914:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839694.898917:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898923:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898932:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839694.898934:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839694.898937:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898942:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657328b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839694.898962:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000550c7dab reply state 00000000d4e0cd4e transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898971:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839694.898977:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:3.0:1788839694.898979:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839694.898982:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839694.899052:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+34:11349:x1875734050166784:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1644us (1940us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788839694.899060:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00010000:00010000:0.0:1788839694.902074:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839694.902089:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.902100:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839694.902104:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.902112:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.902128:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:0.0:1788839694.902132:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788839694.902135:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.902141:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265732a0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.911475:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839694.911482:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839694.911485:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839694.976422:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839694.976506:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050167040 00000100:00100000:0.0:1788839694.976515:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050167040 00000100:00100000:0.0:1788839694.976572:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:0.0:1788839694.976582:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+34:11355:x1875734050167040:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839694.976604:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839694.976636:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265732a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74943 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.976744:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.976759:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.976862:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.976876:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.976883:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839694.976889:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839694.977188:0:12241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788839694.984139:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984163:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984176:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984216:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984224:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984231:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984241:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839694.984245:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984253:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984265:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839694.984267:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839694.984271:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984678:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a265732ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839694.984695:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005278b136 reply state 00000000f8686824 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984706:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.984713:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:2.0:1788839694.984716:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839694.984718:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788839694.984764:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265732a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 37 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.985713:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 36 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.985732:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:2.0:1788839694.985734:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839694.985737:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:2.0:1788839694.986039:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+37:11355:x1875734050167040:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9456us (9623us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788839694.986048:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1788839694.997415:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839694.997509:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050167168 00000100:00100000:2.0:1788839694.997519:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050167168 00000100:00100000:2.0:1788839694.997599:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788839694.997608:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2392:x1875734050167168:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839694.997631:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839694.997651:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7494a expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839694.997675:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839694.997695:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1788839694.997700:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1788839694.997822:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788839694.998101:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.998127:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 8 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839694.998141:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843a00, rc 0) 00000100:00100000:3.0:1788839694.998270:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2392:x1875734050167168:12345-192.168.203.52@tcp:101:bash.0 Request processed in 661us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839694.998278:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788839695.001247:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.001346:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050167296 00000100:00100000:2.0:1788839695.001357:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050167296 00000100:00100000:2.0:1788839695.001422:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788839695.001433:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:11355:x1875734050167296:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839695.001452:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.001472:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74951 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.001503:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.001512:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839695.001531:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839695.001538:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 9 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.001576:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.001591:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.001605:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8539:1875734060728704:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839695.001696:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d73a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839695.016095:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:8539:1875734060728704:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839695.016133:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 9 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.016154:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843400, rc 0) 00000100:00100000:3.0:1788839695.023949:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+9:11355:x1875734050167296:12345-192.168.203.52@tcp:101:bash.0 Request processed in 22505us (22700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.024312:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1788839695.029196:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.029368:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050167424 00000100:00100000:3.0:1788839695.029378:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050167424 00010000:00010000:3.0:1788839695.029420:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.029467:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788839695.029478:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050167424:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839695.029492:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839695.029511:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.029526:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.029548:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a265732ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7494a expref: 9 pid: 8405 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.029567:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839695.029571:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839695.029578:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.029589:0:10307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.029642:0:10307:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.029658:0:10307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10307:1875734060728832:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788839695.029762:0:10307:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839695.037128:0:10307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10307:1875734060728832:192.168.203.52@tcp:105: 00010000:00010000:3.0:1788839695.037156:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839695.037224:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050167424:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 7746us (8036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.037236:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1788839695.042149:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.042248:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050167680 00000100:00100000:2.0:1788839695.042258:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050167680 00000100:00100000:2.0:1788839695.042320:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788839695.042331:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+37:11355:x1875734050167680:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1788839695.042624:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11355:x1875734050167680:12345-192.168.203.52@tcp:35:bash.0 Request processed in 294us (484us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788839695.042633:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00010000:00010000:2.0:1788839695.167045:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839695.286189:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.286294:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050167808 00000100:00100000:2.0:1788839695.286305:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050167808 00000100:00100000:2.0:1788839695.286368:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1788839695.286378:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+38:11371:x1875734050167808:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839695.286402:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.286425:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265732d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74958 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.286489:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265732df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.286504:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265732df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.286516:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265732df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839695.286559:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788839695.286563:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839695.286583:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265732df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.286608:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265732d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74958 expref: 40 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.286628:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265732df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74958 expref: 39 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.286636:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839695.286639:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839695.286657:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842c00, rc 0) 00000100:00100000:2.0:1788839695.286730:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+39:11371:x1875734050167808:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 345us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839695.286737:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:3.0:1788839695.296222:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.296329:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050168064 00000100:00100000:0.0:1788839695.296340:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050168064 00000100:00100000:0.0:1788839695.296405:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1788839695.296415:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+39:11371:x1875734050168064:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839695.296435:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839695.296469:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265732e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7495f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.296579:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265732ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.296594:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265732ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.296605:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265732ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839695.296616:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788839695.296732:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265732e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7495f expref: 42 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.296752:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265732ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7495f expref: 41 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.296761:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:0.0:1788839695.296764:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839695.296768:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfde00, rc 0) 00000100:00100000:0.0:1788839695.296879:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+41:11371:x1875734050168064:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 466us (668us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788839695.296886:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:1.0:1788839695.300548:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.300662:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050168320 00000100:00100000:2.0:1788839695.300671:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050168320 00000100:00100000:2.0:1788839695.300751:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:2.0:1788839695.300763:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+41:11371:x1875734050168320:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839695.300831:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.300862:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265732fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74966 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.300969:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573302 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.300983:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.300995:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573302 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839695.301005:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788839695.301107:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265732fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74966 expref: 44 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.301126:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573302 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74966 expref: 43 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.301134:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:2.0:1788839695.301150:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839695.301154:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843a00, rc 0) 00000100:00100000:2.0:1788839695.301214:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+43:11371:x1875734050168320:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 454us (678us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788839695.301221:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1788839695.308557:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.308639:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050168448 00000100:00100000:0.0:1788839695.308650:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050168448 00000100:00100000:0.0:1788839695.308715:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788839695.308735:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050168448:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:0.0:1788839695.308821:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.308850:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.308859:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788839695.308863:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839695.308867:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.308902:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.308916:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 8 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839695.308929:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875734060728960:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839695.309018:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839695.315855:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875734060728960:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839695.315887:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839695.317041:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.317125:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050168704 00000100:00100000:2.0:1788839695.317133:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050168704 00000100:00100000:2.0:1788839695.317197:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788839695.317208:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+43:2389:x1875734050168704:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839695.317222:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839695.317246:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265732ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7495f expref: 43 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.317264:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:2.0:1788839695.317269:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839695.317328:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+42:2389:x1875734050168704:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 123us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839695.317335:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788839695.320829:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.321155:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050168576 00000100:00100000:2.0:1788839695.321167:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050168576 00002000:00100000:2.0:1788839695.321226:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ab781a49180 x1875734050168576/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:86/0 lens 504/0 e 0 to 0 dl 1788839706 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839695.321237:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab781a49180 with x1875734050168576 ext(0->8) 00010000:00010000:2.0:1788839695.321247:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 9 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.321264:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 9 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839695.321287:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab781a49180 00000100:00100000:2.0:1788839695.321324:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788839695.321334:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2392:x1875734050168576:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:3.0:1788839695.324748:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+11:2392:x1875734050168576:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 3403us (3916us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788839695.324765:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00100000:3.0:1788839695.324831:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8ab781a49180 x1875734050168576/t4294967303(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:86/0 lens 504/448 e 0 to 0 dl 1788839706 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839695.325205:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab781a49180 with x1875734050168576 ext(0->8) 00010000:00010000:3.0:1788839695.325217:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 11 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.325235:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 11 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839695.325260:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab781a49180 00000100:00100000:1.0:1788839695.330030:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.330125:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050168832 00000100:00100000:3.0:1788839695.330135:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050168832 00010000:00010000:3.0:1788839695.330177:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 11 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.330217:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788839695.330226:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+11:2391:x1875734050168832:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839695.330241:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788839695.330257:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788839695.330261:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788839694 00002000:00010000:3.0:1788839695.330263:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788839694 00002000:00010000:3.0:1788839695.330265:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788839694 00002000:00010000:3.0:1788839695.330268:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788839695.330274:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 11 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.330288:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 11 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.330309:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a265732d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74951 expref: 11 pid: 8539 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.330326:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839695.330330:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839695.330343:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.330352:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.330385:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839695.330441:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2391:x1875734050168832:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 215us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.330449:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:0.0:1788839695.330600:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330621:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330641:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330650:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330658:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330664:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839695.330668:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330676:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330688:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.330696:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7aad56a/0xad5b343a26573310 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839695.330832:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050168448:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 22098us (22285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.330848:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:1.0:1788839695.335425:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.335524:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050169088 00000100:00100000:2.0:1788839695.335535:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050169088 00000100:00100000:2.0:1788839695.336160:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788839695.336172:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e578050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+42:11371:x1875734050169088:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:2.0:1788839695.336236:0:6490:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573302 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74966 expref: 42 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839695.336449:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788839695.336480:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788839695.340108:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788839695.340176:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.340196:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 46 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.340204:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.340242:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 46 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.340257:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 46 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.340278:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1875734060729088:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839695.340510:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788839695.344287:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1875734060729088:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839695.344317:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839695.354229:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.354529:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050169216 00000100:00100000:3.0:1788839695.354539:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050169216 00010000:00010000:3.0:1788839695.354580:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 47 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.354641:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788839695.354651:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+47:2390:x1875734050169216:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839695.354666:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839695.354672:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 47 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.354685:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 47 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.354715:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a265732bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74943 expref: 47 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.354742:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:3.0:1788839695.354761:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.355343:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.355353:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.355384:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839695.355447:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+46:2390:x1875734050169216:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 795us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.355456:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00010000:00010000:2.0:1788839695.355519:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.355527:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839695.355651:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788839695.355824:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788839695.355917:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875734060729216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788839695.355969:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839695.356003:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839695.356529:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060729216 00000100:00100000:3.0:1788839695.356537:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060729216 00000100:00100000:3.0:1788839695.356611:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788839695.356620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6490:x1875734060729216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788839695.356733:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6490:x1875734060729216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.356741:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1788839695.359751:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839695.359847:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875734060729216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788839695.360008:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788839695.360087:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875734060729344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788839695.360162:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839695.360190:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839695.360601:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060729344 00000100:00100000:1.0:1788839695.360608:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060729344 00000100:00100000:1.0:1788839695.360660:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788839695.360669:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6490:x1875734060729344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788839695.360886:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6490:x1875734060729344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 219us (724us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788839695.360895:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788839695.362127:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875734060729344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788839695.362199:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788839695.362262:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.362286:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.362295:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.362308:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839695.362312:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.362319:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.362335:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:2.0:1788839695.362338:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788839695.362343:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.362349:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573317 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839695.362450:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788839695.362509:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788839695.362522:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350306750483ns, next at 351306747469ns, rc = 0 00000001:00080000:2.0:1788839695.362529:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788839695.362552:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab646801000) 00010000:00010000:2.0:1788839695.362556:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839695.362562:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573302 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74966 expref: 50 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.362944:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e578050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+49:11371:x1875734050169088:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 26773us (27527us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788839695.362954:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000020:00080000:2.0:1788839695.362959:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788839695.366219:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.366303:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050169344 00000100:00100000:0.0:1788839695.366313:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050169344 00000100:00100000:0.0:1788839695.366373:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:0.0:1788839695.366384:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+49:11371:x1875734050169344:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839695.366408:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839695.366433:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657331e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7496d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.366488:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657331e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7496d expref: 50 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.366503:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657331e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7496d expref: 50 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.366521:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839695.366524:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839695.366527:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd400, rc 0) 00000100:00100000:0.0:1788839695.366583:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+50:11371:x1875734050169344:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 202us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.366590:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:1.0:1788839695.371402:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.371499:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050169600 00000100:00100000:0.0:1788839695.371508:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050169600 00000100:00100000:0.0:1788839695.371583:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1788839695.371604:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+50:11371:x1875734050169600:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839695.372239:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+51:11371:x1875734050169600:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 644us (844us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788839695.372247:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1788839695.491165:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.491311:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050169728 00000100:00100000:3.0:1788839695.491321:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050169728 00000100:00100000:3.0:1788839695.491383:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:3.0:1788839695.491394:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+51:11381:x1875734050169728:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788839695.491470:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.491488:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.491518:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.491531:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.491539:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.491546:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492019:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492029:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492035:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839695.492080:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492093:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492100:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492107:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492124:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839695.492129:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492137:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492149:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:3.0:1788839695.492152:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839695.492157:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492162:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a26573325 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492175:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492180:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492186:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492191:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839695.492194:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492200:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492220:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:3.0:1788839695.492223:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839695.492227:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492233:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a2657332c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492243:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492248:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492254:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492259:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839695.492261:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492267:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492274:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839695.492276:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839695.492279:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.492284:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26573333 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.492408:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+51:11381:x1875734050169728:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1014us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.492416:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:1.0:1788839695.528638:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.528734:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050169984 00000100:00100000:0.0:1788839695.528743:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050169984 00000100:00100000:2.0:1788839695.528953:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:2.0:1788839695.528966:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+51:11384:x1875734050169984:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839695.528989:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.529010:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657333a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74974 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529080:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529095:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529105:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529115:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529123:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529130:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529245:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a2657334f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529271:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a2657334f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529278:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a2657334f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839695.529288:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788839695.529360:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529367:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529374:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529379:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839695.529383:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529390:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529400:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839695.529403:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839695.529406:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529413:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a26573341 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529425:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529436:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529441:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529446:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839695.529449:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529455:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529462:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:2.0:1788839695.529464:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839695.529467:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529472:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573348 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529504:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657333a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74974 expref: 54 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529516:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a2657334f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74974 expref: 53 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.529524:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.529526:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839695.529533:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842000, rc 0) 00000100:00100000:2.0:1788839695.529585:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+53:11384:x1875734050169984:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 623us (957us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788839695.529593:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:0.0:1788839695.537111:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.538576:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050170112 00000100:00100000:3.0:1788839695.538587:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050170112 00000100:00100000:3.0:1788839695.538675:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1788839695.538686:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+53:11384:x1875734050170112:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1788839695.539267:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539286:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539298:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539336:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539344:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539351:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539357:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839695.539362:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539369:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539395:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839695.539399:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839695.539404:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.539410:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a2657335d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.539500:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+53:11384:x1875734050170112:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 814us (2398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.539509:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788839695.552268:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.552356:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050170368 00000100:00100000:2.0:1788839695.552365:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050170368 00000100:00100000:2.0:1788839695.552424:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1788839695.552433:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+53:11384:x1875734050170368:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839695.552693:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+54:11384:x1875734050170368:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 260us (433us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788839695.555038:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788839695.653186:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.653285:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050170624 00000100:00100000:2.0:1788839695.653295:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050170624 00000100:00100000:2.0:1788839695.653358:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1788839695.653370:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+54:11395:x1875734050170624:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839695.653395:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.653399:0:12241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839695.653425:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265732df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74958 expref: 54 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.653443:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839695.653448:0:12241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839695.653461:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573364 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7497b expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.653555:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657336b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.653585:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657336b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.653608:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657336b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839695.653620:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788839695.653737:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573364 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7497b expref: 56 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.653753:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657336b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7497b expref: 55 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.653760:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.653763:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839695.653765:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839695.653880:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+55:11395:x1875734050170624:12345-192.168.203.52@tcp:101:bash.0 Request processed in 513us (703us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788839695.653888:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1788839695.661654:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.661789:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.662388:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050170880 00000100:00100000:2.0:1788839695.662399:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050170880 00000100:00100000:2.0:1788839695.662461:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:2.0:1788839695.662471:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+55:11395:x1875734050170880:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839695.662495:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.662515:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573379 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74982 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.662569:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.662583:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.662594:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.662724:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573379 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 57 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.662744:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 56 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.662754:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.662757:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839695.662760:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842c00, rc 0) 00000100:00100000:2.0:1788839695.662856:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+56:11395:x1875734050170880:12345-192.168.203.52@tcp:101:bash.0 Request processed in 386us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839695.662863:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1788839695.663590:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050170752 00000100:00100000:0.0:1788839695.663599:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050170752 00000100:00100000:0.0:1788839695.663646:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1788839695.663655:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+56:2392:x1875734050170752:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839695.663666:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839695.663684:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a2657336b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7497b expref: 56 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.663698:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839695.663708:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839695.663761:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+55:2392:x1875734050170752:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 107us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.663789:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788839695.667965:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.668163:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050171136 00000100:00100000:2.0:1788839695.668173:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050171136 00000100:00100000:2.0:1788839695.668234:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1788839695.668244:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+55:11395:x1875734050171136:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788839695.668298:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839695.668325:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a2657334f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74974 expref: 55 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.668358:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.668363:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839695.668539:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.668552:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.668562:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839695.668601:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788839695.668641:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000617bacb5 reply state 00000000c952b973 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.668654:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.668660:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.668663:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839695.668666:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839695.668765:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+57:11395:x1875734050171136:12345-192.168.203.52@tcp:36:bash.0 Request processed in 522us (809us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788839695.668800:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000020:00080000:2.0:1788839695.668805:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788839695.671266:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.671336:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050171264 00000100:00100000:0.0:1788839695.671345:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050171264 00000100:00100000:0.0:1788839695.671400:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:0.0:1788839695.671410:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+57:11395:x1875734050171264:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839695.671433:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839695.671466:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657338e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74989 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.671544:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.671556:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.671566:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839695.671591:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788839695.671595:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839695.671611:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.671634:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657338e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 59 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.671651:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.671659:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839695.671661:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839695.671664:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfce00, rc 0) 00000100:00100000:0.0:1788839695.671741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+58:11395:x1875734050171264:12345-192.168.203.52@tcp:101:bash.0 Request processed in 332us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.671748:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1788839695.674560:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.675519:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050171520 00000100:00100000:2.0:1788839695.675530:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050171520 00000100:00100000:2.0:1788839695.675614:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788839695.675625:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+58:11395:x1875734050171520:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1788839695.675903:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11395:x1875734050171520:12345-192.168.203.52@tcp:35:bash.0 Request processed in 279us (1352us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788839695.675910:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1788839695.784057:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.784232:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050171648 00000100:00100000:0.0:1788839695.784256:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050171648 00000100:00100000:0.0:1788839695.784322:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1788839695.784333:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+59:11401:x1875734050171648:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839695.784356:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839695.784376:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657339c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74990 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.784438:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265733a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.784453:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265733a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.784463:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265733a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839695.784504:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788839695.784508:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839695.784529:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265733a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.784555:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657339c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74990 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.784574:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265733a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74990 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.784583:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839695.784586:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839695.784590:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc600, rc 0) 00000100:00100000:0.0:1788839695.784657:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11401:x1875734050171648:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 326us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.784664:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:1.0:1788839695.795409:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.795514:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050171776 00000100:00100000:0.0:1788839695.795524:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050171776 00000100:00100000:0.0:1788839695.795587:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1788839695.795598:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11401:x1875734050171776:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839695.795617:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839695.795638:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265733aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74997 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795700:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795727:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795737:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795748:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795756:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795763:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795858:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795882:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795890:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839695.795931:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788839695.795935:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839695.795953:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795964:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795973:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795979:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795985:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.795991:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839695.795995:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796002:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796013:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839695.796021:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839695.796026:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796032:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796045:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796051:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796057:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796062:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839695.796065:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796071:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796079:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:0.0:1788839695.796081:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839695.796084:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796089:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796117:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a265733aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 62 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796142:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 61 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.796148:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839695.796150:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839695.796152:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfde00, rc 0) 00000100:00100000:0.0:1788839695.796215:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11401:x1875734050171776:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 619us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.796221:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:1.0:1788839695.806678:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.806812:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172032 00000100:00100000:2.0:1788839695.806823:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172032 00000100:00100000:2.0:1788839695.806883:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788839695.806893:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11401:x1875734050172032:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839695.806913:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.806935:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e7499e expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807047:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807061:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807070:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 62 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807077:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807113:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 62 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807125:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 62 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.807158:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060729472:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839695.807265:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.807274:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.807282:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060729600:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839695.807303:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839695.810008:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.810312:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172160 00000100:00100000:2.0:1788839695.810322:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172160 00010000:00010000:2.0:1788839695.810359:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 63 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.810403:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1788839695.810413:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+63:2389:x1875734050172160:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839695.810440:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839695.810447:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 63 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.810460:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 63 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.810482:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.810489:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.810511:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.810517:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839695.810572:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+63:2389:x1875734050172160:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 160us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839695.810580:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00010000:00010000:2.0:1788839695.827268:0:7438:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.52@tcp) returned -22 from blocking AST (req@000000001cd7b2b9 x1875734060729472) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 62 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.827295:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a265733bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74997 expref: 62 pid: 12241 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839695.827315:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060729472:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839695.827329:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060729600:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839695.827350:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.827356:0:7438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.827365:0:7438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.827374:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839695.828831:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839695.828912:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172288 00000100:00100000:0.0:1788839695.828922:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172288 00010000:00010000:0.0:1788839695.828965:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839695.829009:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788839695.829018:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+62:2389:x1875734050172288:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839695.829032:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839695.829038:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.829051:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.829071:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74989 expref: 62 pid: 6488 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.829100:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839695.829104:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.829114:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.829122:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839695.829144:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839695.829239:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.829254:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839695.829273:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788839695.829391:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 63 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.829406:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 62 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.829413:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.829416:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839695.829419:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843c00, rc 0) 00000100:00100000:0.0:1788839695.830946:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+62:2389:x1875734050172288:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1919us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839695.830959:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1788839695.832314:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11401:x1875734050172032:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 25415us (25638us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788839695.832326:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:1.0:1788839695.838037:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839695.838142:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172544 00000100:00100000:3.0:1788839695.838151:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172544 00000100:00100000:3.0:1788839695.838244:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1788839695.838255:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11401:x1875734050172544:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1788839695.838269:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839695.838294:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a2657331e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7496d expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839695.838311:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839695.838330:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839695.838389:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11401:x1875734050172544:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 136us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839695.838397:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788839695.846351:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.846422:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172672 00000100:00100000:2.0:1788839695.846431:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172672 00000100:00100000:2.0:1788839695.846491:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1788839695.846503:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11401:x1875734050172672:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:2.0:1788839695.846638:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.846656:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.846668:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839695.846843:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788839695.846922:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11401:x1875734050172672:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 422us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839695.846930:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:0.0:1788839695.849843:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839695.849926:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172800 00000100:00100000:2.0:1788839695.849935:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172800 00000100:00100000:2.0:1788839695.849994:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1788839695.850004:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+60:11401:x1875734050172800:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839695.850024:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839695.850045:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749a5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.850098:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.850108:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.850126:0:6488:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.850139:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.850152:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839695.850155:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839695.850158:0:6488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839695.850180:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842000, rc 0) 00000100:00100000:2.0:1788839695.850241:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11401:x1875734050172800:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 238us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839695.850249:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00010000:00010000:0.0:1788839696.192048:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839696.254944:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab744356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060729728:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788839696.254974:0:9815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351199202912ns, next at 352199200491ns, rc = 0 00000100:00100000:0.0:1788839696.254997:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839696.255008:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060729856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839696.255017:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839696.255049:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839696.255240:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060729984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839696.255277:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839696.256264:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060730496:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.256278:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060730368:0@lo:400:kworker.0 00000100:00100000:1.0:1788839696.257165:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060730112:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.259373:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839696.261168:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060729728 00000100:00100000:2.0:1788839696.261182:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060729728 00000100:00100000:2.0:1788839696.261244:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060729856 00000100:00100000:2.0:1788839696.261247:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060729856 00000100:00100000:2.0:1788839696.262634:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060729984 00000100:00100000:2.0:1788839696.262644:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060729984 00000100:00100000:2.0:1788839696.262669:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788839696.262678:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060729728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839696.262703:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839696.262831:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060729728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (7812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.262839:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788839696.262857:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788839696.262863:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060729856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839696.262883:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839696.262914:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060729856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (7863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.262920:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788839696.262932:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788839696.262953:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060729984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839696.262963:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839696.262990:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060729984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (7711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.262995:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788839696.263020:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839696.263024:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788839696.263131:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839696.263136:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839696.263181:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788839696.263189:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839696.263538:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cadc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060731648:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839696.263631:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839696.263677:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060730240:0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.263720:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839696.263745:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060730752:0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.263766:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839696.263809:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060731264:0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.263831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839696.263874:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab744356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060729728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839696.263906:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730240 00000100:00100000:2.0:1788839696.263910:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730240 00000100:00100000:2.0:1788839696.263938:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730752 00000100:00100000:2.0:1788839696.263941:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730752 00000100:00100000:2.0:1788839696.263970:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060731264 00000100:00100000:2.0:1788839696.263973:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060731264 00000100:00100000:2.0:1788839696.263988:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788839696.264004:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060730240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.264048:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060730240:12345-0@lo:400:kworker.0 Request processed in 45us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.264054:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788839696.264070:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788839696.264076:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060730752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.264102:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060730752:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.264108:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788839696.264120:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788839696.264126:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060731264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.264153:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060731264:12345-0@lo:400:kworker.0 Request processed in 27us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.264159:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:2.0:1788839696.264174:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839696.264177:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839696.264194:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060730240:0@lo:400:kworker.0 00000100:00100000:2.0:1788839696.264204:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060730752:0@lo:400:kworker.0 00010000:00080000:2.0:1788839696.264215:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7450d9f80 x1875734060731264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839696.264226:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060731264:0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.264391:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839696.264421:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730496 00000100:00100000:0.0:1788839696.264431:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730496 00000100:00100000:0.0:1788839696.264459:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788839696.264466:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060730496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.264499:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060730496:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.264505:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788839696.264537:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060730496:0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.264545:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060731008:0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.264569:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839696.264591:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060731008 00000100:00100000:0.0:1788839696.264594:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060731008 00000100:00100000:0.0:1788839696.264619:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839696.264625:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3615:x1875734060731008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.264653:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3615:x1875734060731008:12345-0@lo:400:kworker.0 Request processed in 28us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.264659:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839696.264682:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060731008:0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.264697:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060729984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839696.264722:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060729856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839696.264743:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060731520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839696.264767:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839696.264804:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060731520 00000100:00100000:0.0:1788839696.264807:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060731520 00000100:00100000:0.0:1788839696.264830:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788839696.264836:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3615:x1875734060731520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839696.264855:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839696.264885:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3615:x1875734060731520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.264891:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788839696.264922:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060731520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839696.265011:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839696.265014:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730368 00000100:00100000:3.0:1788839696.265017:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730368 00000100:00100000:1.0:1788839696.265040:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060730624:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.265044:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788839696.265050:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060730368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839696.265066:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839696.265080:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060730368:12345-0@lo:400:kworker.0 Request processed in 30us (5715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.265083:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060731136:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.265086:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788839696.265097:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730624 00000100:00100000:3.0:1788839696.265099:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730624 00000100:00100000:1.0:1788839696.265103:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839696.265112:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788839696.265123:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060730624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.265151:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060730624:12345-0@lo:400:kworker.0 Request processed in 34us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.265156:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788839696.265295:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060730368:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.265302:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060730880:0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.269523:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730112 00000100:00100000:0.0:1788839696.269539:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730112 00000100:00100000:0.0:1788839696.269609:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788839696.269619:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060730112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.269721:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060730112:12345-0@lo:400:kworker.0 Request processed in 94us (4699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.269729:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788839696.273980:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060730112:0@lo:400:kworker.0 00000100:00100000:1.0:1788839696.274021:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060730624:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.275343:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060731136 00000100:00100000:3.0:1788839696.275356:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060731136 00000100:00100000:3.0:1788839696.275437:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788839696.275447:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060731136:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788839696.275535:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839696.275547:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060731136:12345-0@lo:400:kworker.0 Request processed in 103us (10443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.275554:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788839696.275569:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060731136:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.275596:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839696.275617:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060730880 00000100:00100000:1.0:1788839696.275621:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060730880 00000100:00100000:3.0:1788839696.275625:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060731392:0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.275656:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839696.275666:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788839696.275672:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060730880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839696.275675:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060731392 00000100:00100000:3.0:1788839696.275678:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060731392 00000100:00100000:3.0:1788839696.275701:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839696.275708:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060731392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839696.275724:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060730880:12345-0@lo:400:kworker.0 Request processed in 52us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.275730:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1788839696.275745:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839696.275748:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060731392:12345-0@lo:400:kworker.0 Request processed in 41us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.275754:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839696.275792:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060731392:0@lo:400:kworker.0 00010000:00080000:3.0:1788839696.275816:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4a300 x1875734060730880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839696.275826:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060730880:0@lo:400:kworker.0 00000100:00100000:0.0:1788839696.276049:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.276323:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cadc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060731648:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788839696.276371:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050172928 00000100:00100000:1.0:1788839696.276386:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050172928 00000100:00100000:1.0:1788839696.276430:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1788839696.276438:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11402:x1875734050172928:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839696.276462:0:12241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839696.276566:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11402:x1875734050172928:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 129us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.276574:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00080000:0.0:1788839696.276817:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839696.280389:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.280487:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050173056 00000100:00100000:0.0:1788839696.280496:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050173056 00000100:00100000:0.0:1788839696.280560:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1788839696.280571:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11402:x1875734050173056:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788839696.280641:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280658:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280670:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280685:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280706:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280726:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280750:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280760:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280767:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839696.280843:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788839696.280847:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839696.280859:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280871:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280877:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280885:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280890:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfce00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839696.280894:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280908:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280921:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:0.0:1788839696.280924:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839696.280928:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280934:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265733e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280949:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280955:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280960:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280965:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839696.280968:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280973:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.280980:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8ab777ad0400) 00010000:00010000:0.0:1788839696.280983:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839696.280985:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281001:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265733f0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281015:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281021:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281026:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281031:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839696.281034:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281040:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281049:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839696.281051:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839696.281053:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.281058:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a265733f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839696.281129:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11402:x1875734050173056:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 557us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.281136:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1788839696.284074:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.285346:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050173312 00000100:00100000:1.0:1788839696.285360:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050173312 00000100:00100000:1.0:1788839696.285477:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1788839696.285488:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+61:11402:x1875734050173312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839696.285508:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839696.285532:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265733fe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749ac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285667:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285682:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285692:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839696.285702:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788839696.285822:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285830:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285836:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285842:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839696.285847:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285854:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285865:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:1.0:1788839696.285868:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788839696.285872:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285890:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573405 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285930:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265733fe lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ac expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285940:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:1.0:1788839696.285943:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839696.285946:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265733fe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ac expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.285956:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958a00, rc 0) 00000100:00100000:1.0:1788839696.286018:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+62:11402:x1875734050173312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 532us (1954us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788839696.286026:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1788839696.293161:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.293232:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050173440 00000100:00100000:2.0:1788839696.293241:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050173440 00000100:00100000:2.0:1788839696.293301:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:2.0:1788839696.293310:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+62:11402:x1875734050173440:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788839696.293359:0:12241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788839696.293474:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+62:11402:x1875734050173440:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 164us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.293481:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:2.0:1788839696.297536:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.297612:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050173696 00000100:00100000:0.0:1788839696.297623:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050173696 00000100:00100000:0.0:1788839696.297680:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:0.0:1788839696.297691:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+62:11402:x1875734050173696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839696.297722:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839696.297725:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788839696.297760:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265733a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74990 expref: 62 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.297821:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:0.0:1788839696.297826:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839696.297839:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573413 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749b3 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839696.298216:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788839696.298367:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657341a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.299357:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657341a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.299375:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657341a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.299537:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573413 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749b3 expref: 64 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.299556:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657341a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749b3 expref: 63 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.299579:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab777ad0400) 00010000:00010000:0.0:1788839696.299582:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839696.299586:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfda00, rc 0) 00000100:00100000:0.0:1788839696.299662:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+63:11402:x1875734050173696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1971us (2135us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788839696.299670:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:3.0:1788839696.313247:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.313348:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050173952 00000100:00100000:2.0:1788839696.313358:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050173952 00000100:00100000:2.0:1788839696.313447:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1788839696.313458:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+63:11402:x1875734050173952:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839696.313525:0:12241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839696.313553:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657341a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749b3 expref: 63 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313573:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab777ad0400) 00010000:00010000:2.0:1788839696.313593:0:12241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839696.313613:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313627:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313636:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313650:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313657:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313678:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313743:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313751:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313758:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313763:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839696.313767:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313807:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313815:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839696.313818:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839696.313821:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.313826:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573428 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314080:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314088:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314101:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314105:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839696.314108:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314114:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314123:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x548e0e30 (ffff8ab646801000) 00010000:00010000:2.0:1788839696.314125:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839696.314128:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.314134:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657342f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x548e0e30 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.314221:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+62:11402:x1875734050173952:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 764us (983us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839696.314230:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:3.0:1788839696.316638:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.316804:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050174080 00000100:00100000:1.0:1788839696.316814:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050174080 00000100:00100000:1.0:1788839696.316878:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:1.0:1788839696.316888:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+62:11402:x1875734050174080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839696.316909:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839696.316934:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573436 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749ba expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.316971:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.316986:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.317011:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.317124:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573436 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 64 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.317143:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.317153:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839696.317156:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839696.317159:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958e00, rc 0) 00000100:00100000:1.0:1788839696.317228:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+63:11402:x1875734050174080:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 342us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.317236:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788839696.319732:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.319819:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050174336 00000100:00100000:0.0:1788839696.319829:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050174336 00000100:00100000:0.0:1788839696.319886:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1788839696.319897:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+63:11402:x1875734050174336:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788839696.319995:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.320012:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.320022:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839696.320178:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1788839696.320228:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006871271 reply state 0000000077a2556c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.320241:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.320249:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:0.0:1788839696.320252:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788839696.320262:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839696.320376:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+65:11402:x1875734050174336:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 480us (653us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788839696.320390:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:3.0:1788839696.329114:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.329208:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050174464 00000100:00100000:2.0:1788839696.329218:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050174464 00000100:00100000:2.0:1788839696.329277:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:2.0:1788839696.329288:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+65:11402:x1875734050174464:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839696.329311:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839696.329332:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749c1 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.329411:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.329426:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.329446:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:2.0:1788839696.329449:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839696.329453:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843400, rc 0) 00000100:00100000:2.0:1788839696.329518:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+66:11402:x1875734050174464:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 232us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.329525:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:2.0:1788839696.334366:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.334536:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050174592 00000100:00100000:0.0:1788839696.334546:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050174592 00000100:00100000:0.0:1788839696.334627:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788839696.334638:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050174592:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788839696.334981:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050174592:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 344us (625us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788839696.334998:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00080000:1.0:1788839696.335479:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839696.347217:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.347298:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050174848 00000100:00100000:2.0:1788839696.347307:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050174848 00000100:00100000:2.0:1788839696.347369:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1788839696.347379:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+66:11402:x1875734050174848:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839696.347603:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+67:11402:x1875734050174848:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 225us (395us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788839696.347612:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788839696.353835:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.354279:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050175104 00000100:00100000:1.0:1788839696.354289:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050175104 00000100:00100000:1.0:1788839696.354352:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:1.0:1788839696.354363:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+67:11402:x1875734050175104:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839696.354596:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+67:11402:x1875734050175104:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 234us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.354604:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1788839696.367254:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.367339:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050175232 00000100:00100000:1.0:1788839696.367348:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050175232 00000100:00100000:1.0:1788839696.367421:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1788839696.367433:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+67:11402:x1875734050175232:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839696.367471:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839696.367491:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573452 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749c8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.367569:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573459 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.367583:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.367594:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839696.367640:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839696.367661:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573459 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.367687:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573452 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c8 expref: 69 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.367706:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573459 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c8 expref: 68 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.367726:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839696.367728:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788839696.367731:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959400, rc 0) 00000100:00100000:1.0:1788839696.368038:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+68:11402:x1875734050175232:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 606us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.368045:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1788839696.374627:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.374824:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050175360 00000100:00100000:2.0:1788839696.374843:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050175360 00000100:00100000:2.0:1788839696.374904:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1788839696.374914:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2390:x1875734050175360:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839696.374945:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839696.374966:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749cf expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839696.374991:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f870f, blocks: 0x0 00010000:00010000:2.0:1788839696.375011:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1788839696.375016:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839696.375026:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.375044:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.375068:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:2.0:1788839696.375133:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2390:x1875734050175360:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 220us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.375140:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1788839696.377866:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.377955:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050175616 00000100:00100000:3.0:1788839696.377965:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050175616 00000100:00100000:3.0:1788839696.378024:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1788839696.378035:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+68:11402:x1875734050175616:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788839696.378479:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+68:11402:x1875734050175616:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 446us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.378488:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1788839696.381879:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.382298:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050175744 00000100:00100000:0.0:1788839696.382308:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050175744 00000100:00100000:0.0:1788839696.382368:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1788839696.382379:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+10:11402:x1875734050175744:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839696.382399:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839696.382418:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749d6 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.382452:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 11 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.382461:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839696.382465:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839696.382471:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.382519:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 11 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.382533:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 11 pid: 8403 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839696.382548:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8539:1875734060731776:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839696.382652:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839696.397110:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.397198:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050175872 00000100:00100000:2.0:1788839696.397207:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050175872 00010000:00010000:2.0:1788839696.397248:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 12 pid: 8403 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.397292:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839696.397301:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+12:2389:x1875734050175872:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839696.397333:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839696.397353:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 12 pid: 8403 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.397367:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 12 pid: 8403 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.397391:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839696.397396:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839696.397404:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.397414:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.397450:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.397464:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1875734060731904:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788839696.397548:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788839696.398083:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a26573460 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749cf expref: 12 pid: 8403 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.398100:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c74000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8539:1875734060731776:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839696.398123:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.398133:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfcc00, rc 0) 00000100:00100000:3.0:1788839696.398183:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+11:11402:x1875734050175744:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 15806us (16312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.398191:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788839696.408388:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1875734060731904:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788839696.408416:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839696.408477:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050175872:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 11176us (11375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.408489:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839696.414572:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.414676:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050176000 00000100:00100000:3.0:1788839696.414685:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050176000 00002000:00100000:3.0:1788839696.414755:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ab781a49500 x1875734050176000/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:87/0 lens 504/0 e 0 to 0 dl 1788839707 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839696.414767:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab781a49500 with x1875734050176000 ext(0->12) 00002000:00010000:3.0:1788839696.414806:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab781a49500 00000100:00100000:2.0:1788839696.415069:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788839696.415081:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050176000:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788839696.416004:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+12:2389:x1875734050176000:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 921us (1435us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788839696.416014:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:2.0:1788839696.416023:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8ab781a49500 x1875734050176000/t4294967309(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:87/0 lens 504/448 e 0 to 0 dl 1788839707 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839696.416032:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab781a49500 with x1875734050176000 ext(0->12) 00002000:00010000:2.0:1788839696.416036:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab781a49500 00000100:00100000:0.0:1788839696.420992:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.421102:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050176128 00000100:00100000:1.0:1788839696.421110:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050176128 00000100:00100000:1.0:1788839696.421168:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:1.0:1788839696.421178:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+68:11402:x1875734050176128:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788839696.427446:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788839696.427470:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1788839696.427497:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:2.0:1788839696.427651:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839696.427671:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060732032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788839696.427755:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839696.427832:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060732032 00000100:00100000:2.0:1788839696.427840:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060732032 00000100:00100000:2.0:1788839696.427885:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839696.427893:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060732032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788839696.427918:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788839696.427942:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.427962:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.427971:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788839696.427986:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839696.427991:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.428016:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 11 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.428031:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 11 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.428044:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875734060732160:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839696.428117:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788839696.428524:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428533:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428540:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428546:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839696.428550:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428558:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428573:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8ab647851100) 00010000:00010000:3.0:1788839696.428576:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839696.428581:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428586:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a2657316c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428607:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428613:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428619:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428635:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839696.428638:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428644:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428653:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8ab647851400) 00010000:00010000:3.0:1788839696.428655:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839696.428658:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428663:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573214 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428677:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428683:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428689:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428704:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839696.428708:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428722:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428742:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:3.0:1788839696.428744:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839696.428747:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428752:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573292 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428764:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428813:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428819:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428824:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839696.428826:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428832:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428839:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab647851000) 00010000:00010000:3.0:1788839696.428841:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839696.428844:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428850:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a265732b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428874:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428880:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428885:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428889:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839696.428892:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428897:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428905:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839696.428907:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839696.428910:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428914:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573387 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428925:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428930:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428935:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428947:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839696.428950:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428955:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428964:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:3.0:1788839696.428965:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788839696.428968:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.428973:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573444 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.431206:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.431260:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050176256 00000100:00100000:3.0:1788839696.431268:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050176256 00010000:00010000:3.0:1788839696.431308:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 12 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.431340:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1788839696.431349:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+12:2390:x1875734050176256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839696.431364:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839696.431370:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 12 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.431384:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 12 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.431419:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839696.431424:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839696.431429:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.431440:0:10307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.431460:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839696.431503:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+12:2390:x1875734050176256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 155us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.431511:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00010000:00010000:2.0:1788839696.431839:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573222 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7492e expref: 11 pid: 8404 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.431855:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875734060732160:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839696.431874:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.431884:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.431891:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.431901:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.431915:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.431933:0:8404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788839696.432080:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060732032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4186us (4324us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788839696.432088:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:2.0:1788839696.432124:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab781a48e00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788839696.432134:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060732032:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788839696.432522:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839696.432530:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.432539:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839696.432543:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.432552:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.432566:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.432585:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e6cf67c/0xad5b343a2657346e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.432603:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839696.432605:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839696.432607:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839696.433612:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060732288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788839696.433666:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839696.433960:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060732288 00000100:00100000:1.0:1788839696.433967:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060732288 00000100:00100000:1.0:1788839696.434015:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839696.434024:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3617:x1875734060732288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788839696.434047:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788839696.434089:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f870e, atime: 0x6a9f870e, ctime: 0x6a9f870e, blocks: 0x8 00010000:00010000:1.0:1788839696.434095:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434108:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788839696.434112:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839696.434118:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434132:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434141:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434149:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434183:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788839696.434320:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3617:x1875734060732288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 297us (653us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788839696.434328:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788839696.434349:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839696.434355:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434363:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839696.434368:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434377:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434390:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434397:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ca4095c/0xad5b343a26573475 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.434414:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839696.434415:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839696.434417:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788839696.435302:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab781a4c380/2, rc 0, transno 4294967305 00000100:00100000:3.0:1788839696.435312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060732288:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788839696.435927:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab75190d600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788839696.435933:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab646879900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab75190d000 00000020:00080000:0.0:1788839696.435936:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab646879600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab777a51c00 00000020:00080000:0.0:1788839696.435987:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab6469c3d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788839696.435990:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab647548900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6469c36c0 00000020:00080000:0.0:1788839696.435993:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab647548400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab647598000 00000100:00100000:1.0:1788839696.436200:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11402:x1875734050176128:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 15021us (15215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.436220:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000020:00080000:2.0:1788839696.436970:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788839696.437026:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1788839696.439420:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788839696.439436:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788839696.440338:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.440427:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050176384 00000100:00100000:3.0:1788839696.440436:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050176384 00000100:00100000:3.0:1788839696.440526:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1788839696.440536:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+11:2390:x1875734050176384:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788839696.442457:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788839696.442470:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:3.0:1788839696.442637:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050176384:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 2098us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.442648:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788839696.445999:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.446107:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050176640 00000100:00100000:1.0:1788839696.446116:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050176640 00000100:00100000:1.0:1788839696.446161:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:1.0:1788839696.446169:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11402:x1875734050176640:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839696.446222:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839696.446249:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573459 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c8 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.446267:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839696.446271:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839696.446298:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.446313:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.446322:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839696.446435:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5924a26 reply state 00000000fd2bd47e transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.446448:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.446454:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839696.446462:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839696.446465:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839696.446568:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e678000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+17:11402:x1875734050176640:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 399us (576us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788839696.446577:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:0.0:1788839696.449545:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.449629:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050176768 00000100:00100000:2.0:1788839696.449638:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050176768 00000100:00100000:2.0:1788839696.449701:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788839696.449720:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050176768:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788839696.449911:0:8404:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788839696.449915:0:8404:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788839694 00002000:00010000:2.0:1788839696.449917:0:8404:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788839694 00002000:00010000:2.0:1788839696.449919:0:8404:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788839695 -> 1788839694 00002000:00010000:2.0:1788839696.449921:0:8404:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788839696.449968:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050176768:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 259us (431us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788839696.449988:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788839696.453615:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.453931:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177024 00000100:00100000:2.0:1788839696.453941:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177024 00000100:00100000:2.0:1788839696.454004:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:2.0:1788839696.454015:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+17:11402:x1875734050177024:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788839696.454089:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.454105:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.454114:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.454148:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.454160:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 17 pid: 6487 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.454174:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060732416:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839696.454357:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839696.457440:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.457977:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177152 00000100:00100000:3.0:1788839696.457986:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177152 00010000:00010000:3.0:1788839696.458027:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 18 pid: 6487 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.458104:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1788839696.458115:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2390:x1875734050177152:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839696.458128:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839696.458148:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 18 pid: 6487 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.458162:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 18 pid: 6487 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.458185:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:3.0:1788839696.458190:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.458200:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.458208:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.458224:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839696.458280:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2390:x1875734050177152:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 166us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.458288:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00010000:00010000:2.0:1788839696.458988:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657343d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749ba expref: 17 pid: 6487 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.459007:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060732416:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839696.459040:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459049:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459055:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459092:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459099:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459106:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459111:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839696.459116:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459123:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459134:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:2.0:1788839696.459137:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788839696.459141:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.459147:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573483 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.459206:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11402:x1875734050177024:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 5192us (5599us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788839696.459214:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:0.0:1788839696.462076:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.462170:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177280 00000100:00100000:2.0:1788839696.462180:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177280 00000100:00100000:2.0:1788839696.462271:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788839696.462282:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050177280:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788839696.462328:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.462348:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.462355:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839696.462359:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839696.462363:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.462396:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.462410:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 7 pid: 8539 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.462423:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8538:1875734060732544:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839696.462517:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788839696.464535:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.464612:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8538:1875734060732544:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839696.464641:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.464669:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177408 00000100:00100000:2.0:1788839696.464674:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177408 00010000:00010000:2.0:1788839696.464725:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 8 pid: 8539 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.464760:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:2.0:1788839696.464790:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050177408:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839696.464805:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839696.464837:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 8 pid: 8539 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.464851:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 8 pid: 8539 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.464873:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b44da7c6/0xad5b343a26573467 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749d6 expref: 8 pid: 8539 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.464887:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839696.464891:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839696.464896:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.464923:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.464947:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839696.464992:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050177408:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 224us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.465001:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:2.0:1788839696.465023:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465033:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465051:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465060:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465069:0:8538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465076:0:8538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839696.465081:0:8538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465100:0:8538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465112:0:8538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.465119:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd35d611/0xad5b343a2657348a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839696.465160:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050177280:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 2880us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.465168:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788839696.467667:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839696.467804:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177664 00000100:00100000:1.0:1788839696.467812:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177664 00000100:00100000:1.0:1788839696.467871:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:1.0:1788839696.467880:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:11402:x1875734050177664:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788839696.467946:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.467962:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 16 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.467971:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.468002:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 16 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.468015:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 16 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839696.468029:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060732672:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839696.468096:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d73a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839696.470113:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060732672:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839696.470143:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.470942:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.471008:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177792 00000100:00100000:0.0:1788839696.471015:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177792 00010000:00010000:0.0:1788839696.471047:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 17 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839696.471083:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1788839696.471091:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+17:2389:x1875734050177792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839696.471104:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839696.471110:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 17 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471122:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 17 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471142:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74982 expref: 17 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471157:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839696.471162:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471172:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471180:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471195:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839696.471224:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839696.471272:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+16:2389:x1875734050177792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 180us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.471279:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00010000:00010000:3.0:1788839696.471615:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.471624:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.471846:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.471864:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 16 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.471873:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.471901:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 16 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.471914:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 16 pid: 12241 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.471927:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060732800:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839696.471978:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839696.474355:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060732800:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839696.474382:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839696.475903:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.476257:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050177920 00000100:00100000:3.0:1788839696.476269:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050177920 00010000:00010000:3.0:1788839696.476311:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 17 pid: 12241 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.476353:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1788839696.476363:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+17:2390:x1875734050177920:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839696.476375:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839696.476381:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 17 pid: 12241 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.476394:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 17 pid: 12241 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.476442:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657344b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749c1 expref: 17 pid: 12241 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.476460:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:3.0:1788839696.476465:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.476474:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.476482:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.476508:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839696.476562:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648289f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+16:2390:x1875734050177920:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 200us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.476570:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00010000:00010000:1.0:1788839696.476656:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.476665:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839696.476812:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788839696.476940:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788839696.476977:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788839696.477051:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875734060732928:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839696.477099:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839696.477135:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060732928 00000100:00100000:1.0:1788839696.477140:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060732928 00000100:00100000:1.0:1788839696.477172:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788839696.477179:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1875734060732928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839696.477250:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1875734060732928:12345-0@lo:1000:mdt00_000.0 Request processed in 70us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839696.477257:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788839696.477280:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839696.477301:0:6487:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788839696.477306:0:6487:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:1.0:1788839696.477323:0:6487:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab781a48e00, transno 4294967310 00000100:00100000:1.0:1788839696.477333:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875734060732928:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788839696.477438:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788839696.477475:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875734060733056:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839696.477511:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839696.477525:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839696.477662:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060733056 00000100:00100000:0.0:1788839696.477667:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060733056 00000100:00100000:0.0:1788839696.477699:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788839696.477707:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6487:x1875734060733056:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839696.477844:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6487:x1875734060733056:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (332us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788839696.477851:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788839696.478252:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875734060733056:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788839696.478283:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478292:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478300:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478307:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839696.478312:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478320:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478334:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839696.478337:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839696.478341:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478347:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26573498 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478369:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478384:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478390:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478396:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839696.478399:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478406:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478414:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:1.0:1788839696.478417:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839696.478423:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478434:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478445:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.478472:0:6487:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839696.478484:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060733184:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788839696.478563:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748528f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839696.482880:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060733184:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788839696.482914:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.482925:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842e00/0xad5b343a265733db lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.482958:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.482974:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.482984:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.482995:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483001:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483008:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483014:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839696.483017:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483024:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483056:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:1.0:1788839696.483058:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839696.483063:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483068:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657349f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483079:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483085:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483091:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483096:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839696.483099:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483106:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483113:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:1.0:1788839696.483116:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839696.483119:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.483124:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573491 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839696.483420:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839696.483425:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839696.483947:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788839696.483957:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788839696.484169:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11402:x1875734050177664:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 16286us (16508us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788839696.484181:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000020:00080000:1.0:1788839696.484187:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788839696.485434:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.487320:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050178048 00000100:00100000:3.0:1788839696.487332:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050178048 00000100:00100000:3.0:1788839696.487383:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1788839696.487393:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11401:x1875734050178048:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:3.0:1788839696.487521:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11401:x1875734050178048:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 129us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.487548:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1788839696.487670:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839696.488088:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050178304 00000100:00100000:2.0:1788839696.488093:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050178304 00000100:00100000:2.0:1788839696.488117:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1788839696.488123:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e578450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:11402:x1875734050178304:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788839696.488344:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788839696.488376:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:2.0:1788839696.488408:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.488425:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.488436:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.488452:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.488459:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.488465:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.488493:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788839696.488558:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e578450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+21:11402:x1875734050178304:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 433us (887us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788839696.488566:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000020:00080000:2.0:1788839696.488570:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788839696.488967:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839696.488974:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.488982:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839696.488986:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.488994:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.489008:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839696.489010:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788839696.489015:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.489021:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265734a6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839696.489035:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839696.489037:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839696.489038:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839696.492423:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.492505:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050178560 00000100:00100000:0.0:1788839696.492515:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050178560 00000100:00100000:0.0:1788839696.492605:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:0.0:1788839696.492616:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+21:11401:x1875734050178560:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:0.0:1788839696.492823:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788839696.492919:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+21:11401:x1875734050178560:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 304us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839696.492928:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:1.0:1788839696.516844:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.516941:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050178688 00000100:00100000:3.0:1788839696.516952:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050178688 00000100:00100000:3.0:1788839696.517015:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:3.0:1788839696.517025:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+21:11404:x1875734050178688:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839696.517046:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839696.517069:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749dd expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517131:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517147:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517157:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517172:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517179:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517186:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517259:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517287:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 22 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517295:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517331:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 22 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.517345:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 22 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.517360:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060733312:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839696.517445:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1780 going to sleep for 11 seconds 00000100:00100000:2.0:1788839696.524048:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839696.524452:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050178944 00000100:00100000:0.0:1788839696.524462:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050178944 00000100:00100000:0.0:1788839696.524559:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788839696.524570:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+23:6163:x1875734050178944:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788839696.524869:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+24:6163:x1875734050178944:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 301us (831us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788839696.524877:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1788839696.525003:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060733312:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839696.525029:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839696.527363:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839696.527739:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179072 00000100:00100000:3.0:1788839696.527750:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179072 00010000:00010000:3.0:1788839696.527822:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 24 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839696.527853:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1788839696.527862:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+24:2390:x1875734050179072:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839696.528488:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839696.528505:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 24 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.528519:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 24 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.528542:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265733cd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7499e expref: 24 pid: 7438 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.528559:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839696.528565:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.528575:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.528583:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839696.528672:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839696.528742:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+23:2390:x1875734050179072:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 880us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.528750:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00010000:00010000:2.0:1788839696.529109:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529118:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839696.529172:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788839696.529177:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839696.529197:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529210:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529218:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529245:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529252:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529258:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839696.529262:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529270:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529281:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839696.529283:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839696.529288:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529294:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265734b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529307:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529314:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529319:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529325:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839696.529334:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529341:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529349:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8ab747cc7a00) 00010000:00010000:2.0:1788839696.529352:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839696.529355:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529361:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529404:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749dd expref: 23 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529419:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749dd expref: 22 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839696.529431:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839696.529433:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839696.529435:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7e00, rc 0) 00000100:00100000:2.0:1788839696.529466:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11404:x1875734050178688:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 12443us (12632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839696.529473:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:2.0:1788839696.767397:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839696.767422:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060733440:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839696.767496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839696.767623:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060733440 00000100:00100000:3.0:1788839696.767632:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060733440 00000100:00100000:3.0:1788839696.767684:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788839696.767703:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060733440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839696.767744:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788839696.767818:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060733440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839696.767831:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788839696.768029:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060733440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839697.068279:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068373:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068397:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068422:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068440:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068455:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068477:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839697.068505:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179456 00000100:00100000:0.0:1788839697.068509:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179712 00000100:00100000:1.0:1788839697.068514:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179456 00000100:00100000:0.0:1788839697.068516:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179712 00000100:00100000:1.0:1788839697.068565:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179968 00000100:00100000:1.0:1788839697.068568:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179968 00000100:00100000:0.0:1788839697.068571:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179584 00000100:00100000:0.0:1788839697.068576:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179584 00000100:00100000:1.0:1788839697.068587:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179328 00000100:00100000:1.0:1788839697.068592:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179328 00000100:00100000:1.0:1788839697.068611:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179840 00000100:00100000:1.0:1788839697.068613:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179840 00000100:00100000:1.0:1788839697.068629:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:1.0:1788839697.068637:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050179456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839697.068702:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050179456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 66us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839697.068720:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1788839697.068724:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:0.0:1788839697.068735:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050179712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839697.068746:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:1.0:1788839697.068755:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050179968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839697.068793:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050179712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839697.068801:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1788839697.068807:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050179968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 51us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839697.068820:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:1.0:1788839697.068826:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:0.0:1788839697.068831:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050179584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839697.068847:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:1.0:1788839697.068856:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2389:x1875734050179328:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839697.068863:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050179584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839697.068872:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1788839697.068899:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:0.0:1788839697.068910:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050179840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839697.068912:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2389:x1875734050179328:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 55us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839697.068922:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00080000:1.0:1788839697.068942:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839697.068945:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050179840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839697.068952:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00080000:1.0:1788839697.068960:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839697.068964:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839697.073994:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050179200 00000100:00100000:3.0:1788839697.074009:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050179200 00000100:00100000:2.0:1788839697.081225:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 385 00000100:00100000:2.0:1788839697.081239:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050179200:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839697.081321:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050179200:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 85us (13053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839697.081329:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 385 00000040:00080000:3.0:1788839697.206507:0:14228:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839697.206517:0:14228:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839697.206548:0:14228:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788839697.206554:0:14228:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788839697.218109:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839697.535217:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839697.535228:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839697.535272:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788839697.535282:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839697.535417:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060733568:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839697.535579:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab748528f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839697.544838:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060733568:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788839697.546385:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839697.546487:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050180096 00000100:00100000:2.0:1788839697.546496:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050180096 00000100:00100000:2.0:1788839697.546558:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:2.0:1788839697.546569:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11416:x1875734050180096:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788839697.546601:0:12241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788839697.546733:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11416:x1875734050180096:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 165us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839697.546740:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:2.0:1788839697.565048:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839697.565337:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050180352 00000100:00100000:0.0:1788839697.565348:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050180352 00000100:00100000:0.0:1788839697.565418:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:0.0:1788839697.565429:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+22:11416:x1875734050180352:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839697.565450:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839697.565472:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265734c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749e4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839697.565580:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265734d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839697.565596:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265734d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839697.565607:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265734d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839697.565618:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788839697.565730:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265734c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749e4 expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839697.565749:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265734d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749e4 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839697.565758:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:0.0:1788839697.565761:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839697.565765:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd400, rc 0) 00000100:00100000:0.0:1788839697.565850:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+24:11416:x1875734050180352:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 423us (813us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788839697.565866:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:0.0:1788839697.571409:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839697.571498:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050180480 00000100:00100000:3.0:1788839697.571507:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050180480 00000100:00100000:3.0:1788839697.571572:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1788839697.571583:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+24:2390:x1875734050180480:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839697.571611:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839697.571638:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265734d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749e4 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.571658:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839697.571663:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839697.571730:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+23:2390:x1875734050180480:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 149us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839697.571748:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1788839697.572347:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839697.572403:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050180736 00000100:00100000:3.0:1788839697.572408:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050180736 00000100:00100000:3.0:1788839697.572447:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:3.0:1788839697.572455:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+23:11416:x1875734050180736:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788839697.572523:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.572537:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.572546:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.572973:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.572981:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.572988:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.572994:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839697.573069:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.573080:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.573091:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839697.573103:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839697.573108:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839697.573185:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839697.574288:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+24:11416:x1875734050180736:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 1827us (1936us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788839697.574300:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000040:00080000:0.0:1788839697.575200:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839697.575206:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839697.575744:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788839697.575755:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839697.585937:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839697.587436:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050180992 00000100:00100000:2.0:1788839697.587448:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050180992 00000100:00100000:0.0:1788839697.587557:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1788839697.587568:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+24:11416:x1875734050180992:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839697.587821:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+25:11416:x1875734050180992:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 253us (1892us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788839697.587829:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00010000:00010000:1.0:1788839698.239381:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839698.814948:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839698.814973:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64828a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060733696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839698.815037:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839698.815117:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060733696 00000100:00100000:0.0:1788839698.815124:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060733696 00000100:00100000:0.0:1788839698.815168:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788839698.815177:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060733696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839698.815210:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839698.815254:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060733696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839698.815262:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788839698.815304:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64828a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060733696:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788839699.090349:0:14279:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839699.090358:0:14279:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839699.090401:0:14279:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788839699.090409:0:14279:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788839699.264175:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839699.321883:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839699.321977:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050181248 00000100:00100000:3.0:1788839699.322036:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050181248 00000100:00080000:1.0:1788839699.322099:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839699.322119:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1788839699.322131:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+25:11436:x1875734050181248:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839699.322159:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839699.322180:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265734e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749eb expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.322293:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.322307:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.322318:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839699.322329:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788839699.322449:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265734e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749eb expref: 28 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.322475:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749eb expref: 27 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.322483:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839699.322486:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788839699.322490:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7800, rc 0) 00000100:00100000:3.0:1788839699.322557:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+27:11436:x1875734050181248:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 428us (683us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788839699.322564:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:1.0:1788839699.325872:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839699.325932:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050181376 00000100:00100000:3.0:1788839699.325943:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050181376 00000100:00100000:3.0:1788839699.326011:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:3.0:1788839699.326022:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+27:11436:x1875734050181376:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1788839699.326096:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326116:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326127:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326164:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326172:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326190:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326197:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839699.326201:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326209:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326221:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:3.0:1788839699.326225:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839699.326230:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839699.326236:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a265734fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839699.326302:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+27:11436:x1875734050181376:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 282us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839699.326309:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:1.0:1788839699.479326:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839699.479525:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050181504 00000100:00100000:2.0:1788839699.479535:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050181504 00000100:00100000:2.0:1788839699.479612:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1788839699.479623:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050181504:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788839699.479655:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839699.479674:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006f9f45f/0xad5b343a26573501 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749f2 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839699.479708:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f870e, atime: 0x6a9f870e, ctime: 0x6a9f870e, blocks: 0x8 00010000:00010000:2.0:1788839699.479727:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1788839699.479731:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839699.479740:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006f9f45f/0xad5b343a26573501 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f2 expref: 7 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839699.479758:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000006f9f45f/0xad5b343a26573501 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f2 expref: 7 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839699.479809:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842e00, rc 0) 00000100:00100000:2.0:1788839699.479861:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2392:x1875734050181504:12345-192.168.203.52@tcp:101:cat.0 Request processed in 240us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839699.479868:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00080000:1.0:1788839699.479929:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839699.483351:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839699.483443:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050181632 00000100:00100000:3.0:1788839699.483452:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050181632 00002000:00100000:3.0:1788839699.483501:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ab648267480 x1875734050181632/t0(0) o3->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:90/0 lens 488/0 e 0 to 0 dl 1788839710 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839699.483512:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab648267480 with x1875734050181632 ext(0->4095) 00002000:00010000:3.0:1788839699.483518:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab648267480 00000100:00100000:3.0:1788839699.483553:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788839699.483564:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050181632:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:3.0:1788839699.483812:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050181632:12345-192.168.203.52@tcp:3:cat.0 Request processed in 249us (474us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788839699.483821:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:3.0:1788839699.483828:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8ab648267480 x1875734050181632/t0(0) o3->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:90/0 lens 488/4536 e 0 to 0 dl 1788839710 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839699.483836:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab648267480 with x1875734050181632 ext(0->4095) 00002000:00010000:3.0:1788839699.483840:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab648267480 00010000:00010000:1.0:1788839700.286948:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839701.311466:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839701.375420:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060733824:0@lo:400:kworker.0 00000100:00100000:3.0:1788839701.375496:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060734208:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375524:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839701.375539:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.375596:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060734336:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375628:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.375652:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060734848:0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.375687:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060734080:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.375726:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060735360:0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.375727:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839701.375750:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060734592:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375766:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839701.375805:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.375812:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788839701.375822:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060733952:0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.375830:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060735104:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839701.375870:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060733824 00000100:00100000:0.0:1788839701.375878:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060733824 00000100:00100000:2.0:1788839701.375887:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060734464:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375916:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.375938:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060734976:0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.375942:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788839701.375956:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060733824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.375963:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.375981:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64828a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060735488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839701.376017:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839701.376022:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060733824:12345-0@lo:400:kworker.0 Request processed in 68us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376032:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788839701.376069:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060733824:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.376107:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734336 00000004:00080000:0.0:1788839701.376111:0:9815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356320339452ns, next at 357320337165ns, rc = 0 00000100:00100000:2.0:1788839701.376112:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734336 00000100:00100000:2.0:1788839701.376146:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734080 00000100:00100000:2.0:1788839701.376150:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734080 00000100:00100000:0.0:1788839701.376164:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734848 00000100:00100000:0.0:1788839701.376169:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734848 00000100:00100000:2.0:1788839701.376170:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788839701.376193:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060734336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.376209:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735360 00000100:00100000:0.0:1788839701.376214:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735360 00000100:00100000:2.0:1788839701.376238:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060734336:12345-0@lo:400:kworker.0 Request processed in 59us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376244:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788839701.376257:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788839701.376258:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060734848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.376277:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788839701.376286:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060734080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.376298:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060734848:12345-0@lo:400:kworker.0 Request processed in 43us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376305:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788839701.376322:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788839701.376326:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648289500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060734080:12345-0@lo:400:kworker.0 Request processed in 40us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376334:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060735360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.376337:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788839701.376368:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734208 00000100:00100000:2.0:1788839701.376372:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734208 00000100:00100000:0.0:1788839701.376374:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060735360:12345-0@lo:400:kworker.0 Request processed in 43us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376383:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788839701.376393:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734592 00000100:00100000:2.0:1788839701.376397:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734592 00000100:00100000:2.0:1788839701.376411:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060733952 00000100:00100000:2.0:1788839701.376413:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060733952 00000100:00080000:0.0:1788839701.376419:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839701.376426:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839701.376427:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734464 00000100:00100000:2.0:1788839701.376430:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734464 00000100:00080000:0.0:1788839701.376436:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839701.376440:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839701.376445:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734976 00000100:00100000:2.0:1788839701.376448:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734976 00000100:00100000:0.0:1788839701.376458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.376470:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735104 00000100:00100000:2.0:1788839701.376473:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735104 00000100:00100000:0.0:1788839701.376484:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64828a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060735616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839701.376490:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788839701.376497:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060734208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.376515:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.376544:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060734208:12345-0@lo:400:kworker.0 Request processed in 46us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839701.376551:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788839701.376553:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060734080:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.376567:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788839701.376571:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839701.376576:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060734592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.376582:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060735744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839701.376612:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648289c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060734592:12345-0@lo:400:kworker.0 Request processed in 38us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376620:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.376624:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788839701.376638:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788839701.376645:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060733952:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788839701.376658:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6482d6a00 x1875734060734592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839701.376671:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060734592:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.376675:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060733952:12345-0@lo:400:kworker.0 Request processed in 30us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839701.376697:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788839701.376708:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735488 00000100:00100000:2.0:1788839701.376713:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788839701.376714:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735488 00000100:00100000:2.0:1788839701.376722:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060734464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.376743:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735616 00000100:00100000:0.0:1788839701.376748:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735616 00000100:00100000:2.0:1788839701.376761:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060734464:12345-0@lo:400:kworker.0 Request processed in 41us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.376761:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735744 00000100:00100000:0.0:1788839701.376765:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735744 00000100:00100000:2.0:1788839701.376796:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788839701.376809:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788839701.376815:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788839701.376821:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060735488:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839701.376826:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060734976:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788839701.376848:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839701.376854:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060734976:12345-0@lo:400:kworker.0 Request processed in 32us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839701.376861:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788839701.376877:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788839701.376884:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060735104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839701.376902:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060735488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839701.376910:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839701.376910:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788839701.376920:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060735104:12345-0@lo:400:kworker.0 Request processed in 36us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839701.376929:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788839701.376929:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060735872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839701.376931:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788839701.376945:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060735616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839701.376957:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839701.376961:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788839701.376973:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060735744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839701.376989:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788839701.377385:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060735616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 443us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839701.377391:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788839701.377871:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839701.377875:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060735744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 902us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839701.377885:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788839701.377940:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735872 00000100:00100000:2.0:1788839701.377947:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735872 00000100:00100000:2.0:1788839701.377971:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788839701.377976:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060735872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839701.377990:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788839701.378017:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060735872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839701.378031:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788839701.378068:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648289180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060735872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839701.378123:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648288000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060735744:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788839701.378127:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839701.378133:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839701.378136:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839701.378138:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000100:00080000:2.0:1788839701.378139:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788839701.378147:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1788839701.378167:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab6480f7b80, transno 4294967302 00000100:00100000:2.0:1788839701.378171:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060733952:0@lo:400:kworker.0 00000004:00080000:1.0:1788839701.378183:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000100:00100000:2.0:1788839701.378188:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060734464:0@lo:400:kworker.0 00000004:00080000:1.0:1788839701.378199:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab781a4c380, transno 4294967305 00000100:00100000:2.0:1788839701.378205:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060734976:0@lo:400:kworker.0 00000100:00100000:1.0:1788839701.378212:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64828a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060735616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839701.378225:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64828a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060735488:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788839701.378236:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6482d5500 x1875734060735104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839717 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839701.378242:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060734336:0@lo:400:kworker.0 00000100:00100000:1.0:1788839701.378260:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060735104:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.378309:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060734848:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.378321:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060735360:0@lo:400:kworker.0 00000100:00100000:3.0:1788839701.382277:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060734208:0@lo:400:kworker.0 00000100:00100000:3.0:1788839701.382295:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060734720:0@lo:400:kworker.0 00000100:00100000:3.0:1788839701.382371:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839701.382410:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060735232:0@lo:400:kworker.0 00000100:00100000:3.0:1788839701.382432:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839701.382794:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060734720 00000100:00100000:1.0:1788839701.382801:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060734720 00000100:00100000:1.0:1788839701.382842:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060735232 00000100:00100000:1.0:1788839701.382845:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060735232 00000100:00100000:1.0:1788839701.382904:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839701.382913:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060734720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839701.382973:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060734720:12345-0@lo:400:kworker.0 Request processed in 62us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839701.382981:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788839701.382997:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788839701.383003:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060735232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839701.383030:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060735232:12345-0@lo:400:kworker.0 Request processed in 28us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839701.383035:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788839701.383159:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060734720:0@lo:400:kworker.0 00000100:00100000:2.0:1788839701.383172:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060735232:0@lo:400:kworker.0 00000001:00080000:0.0:1788839701.893283:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788839701.893297:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:3.0:1788839701.893584:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839701.893605:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060736000:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839701.893684:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839701.893749:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736000 00000100:00100000:3.0:1788839701.893758:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736000 00000100:00100000:3.0:1788839701.893944:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788839701.893959:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060736000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839701.893991:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788839701.894065:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060736000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839701.894082:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788839701.894193:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060736000:0@lo:41:osp-pre-0-1.0 00000004:00080000:3.0:1788839701.896254:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:0.0:1788839701.896414:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060736128:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1788839701.896422:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:3.0:1788839701.896450:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab75e4ae900 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788839701.896454:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab777ca0100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab742f0dcc0 00000020:00080000:3.0:1788839701.896456:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab777ca0900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab754569e00 00000100:00100000:0.0:1788839701.896478:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788839701.896479:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788839701.896491:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:2.0:1788839701.896546:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736128 00000100:00100000:2.0:1788839701.896553:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736128 00000020:00080000:3.0:1788839701.896568:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788839701.896592:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788839701.896601:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060736128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788839701.896718:0:8538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788839701.896722:0:8538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788839694 -> 1788839694 00002000:00010000:2.0:1788839701.896725:0:8538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 1788839694 -> 1788839694 00002000:00010000:2.0:1788839701.896740:0:8538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788839694 -> 1788839694 00002000:00010000:2.0:1788839701.896742:0:8538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788839701.896862:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060736128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 261us (383us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788839701.896869:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788839701.896997:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788839701.897003:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788839701.897024:0:3614:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab647bb6680 x1875734060736128/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788839717 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788839701.897035:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab647bb6680/2, rc 0, transno 4294967313 00000100:00100000:0.0:1788839701.897040:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060736128:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788839701.897275:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839701.897286:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839701.897297:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839701.897303:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839701.897307:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839701.897327:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839701.897343:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839701.897346:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839701.897351:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839701.897356:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657347c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839702.185950:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186003:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186045:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186135:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186167:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186198:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839702.186229:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182144 00000100:00100000:3.0:1788839702.186239:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182144 00000100:00100000:3.0:1788839702.186310:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182272 00000100:00100000:3.0:1788839702.186314:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182272 00000100:00100000:3.0:1788839702.186348:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:3.0:1788839702.186359:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050182144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839702.186432:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050182144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839702.186441:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:3.0:1788839702.186465:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1788839702.186484:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050182272:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839702.186518:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050182272:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839702.186525:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1788839702.186549:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050181888 00000100:00100000:3.0:1788839702.186552:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050181888 00000100:00100000:3.0:1788839702.186589:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182400 00000100:00100000:3.0:1788839702.186593:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182400 00000100:00100000:3.0:1788839702.186611:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182016 00000100:00100000:3.0:1788839702.186614:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182016 00000100:00100000:3.0:1788839702.186636:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182528 00000100:00100000:3.0:1788839702.186639:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182528 00000100:00100000:3.0:1788839702.186656:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 308 00000100:00100000:3.0:1788839702.186669:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+13:2391:x1875734050181888:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839702.186708:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+13:2391:x1875734050181888:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839702.186714:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 308 00000100:00100000:3.0:1788839702.186727:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:3.0:1788839702.186734:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050182400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839702.186746:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 310 00000100:00100000:3.0:1788839702.186759:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050182400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839702.186763:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050182016:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839702.186793:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:3.0:1788839702.186811:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:3.0:1788839702.186823:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050182528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839702.186824:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050182016:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 64us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839702.186836:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 310 00000100:00100000:3.0:1788839702.186857:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050182528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839702.186871:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:3.0:1788839702.186896:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050181760 00000100:00100000:3.0:1788839702.186900:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050181760 00000100:00100000:3.0:1788839702.186938:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 387 00000100:00100000:3.0:1788839702.186945:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050181760:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839702.186969:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050181760:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839702.186975:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 387 00000100:00080000:3.0:1788839702.187001:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839702.187005:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839702.187008:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839702.187010:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788839702.336102:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839703.367521:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839703.750087:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839703.750098:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839703.750119:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788839703.750124:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788839703.937059:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839703.937081:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060736256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839703.937144:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839703.937204:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736256 00000100:00100000:1.0:1788839703.937212:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736256 00000100:00100000:1.0:1788839703.937257:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788839703.937266:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060736256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839703.937301:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839703.937344:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060736256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839703.937365:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788839703.937413:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060736256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839704.245884:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839704.246355:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182656 00000100:00100000:2.0:1788839704.246373:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182656 00000100:00100000:2.0:1788839704.246445:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:2.0:1788839704.246455:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11089:x1875734050182656:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788839704.246563:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11089:x1875734050182656:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 109us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839704.246570:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00080000:3.0:1788839704.246859:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839704.248420:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839704.248683:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050182784 00000100:00100000:1.0:1788839704.248692:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050182784 00000100:00100000:1.0:1788839704.248764:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:1.0:1788839704.248796:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:11089:x1875734050182784:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788839704.248894:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+5:11089:x1875734050182784:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 101us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839704.248901:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00080000:3.0:1788839704.248961:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839704.251984:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839704.252071:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183040 00000100:00100000:3.0:1788839704.252082:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183040 00000100:00100000:3.0:1788839704.252205:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1788839704.252216:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+13:11089:x1875734050183040:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788839704.252435:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+14:11089:x1875734050183040:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 221us (460us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788839704.252444:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000040:00080000:0.0:1788839704.255901:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788839704.383046:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839704.643487:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839704.643584:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183168 00000100:00100000:3.0:1788839704.643593:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183168 00000100:00100000:3.0:1788839704.643680:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:3.0:1788839704.643690:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+5:11895:x1875734050183168:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:3.0:1788839704.643726:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839704.643759:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e749f9 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839704.643848:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839704.643862:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839704.643872:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839704.643914:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788839704.643918:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839704.643956:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839704.643980:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 7 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839704.643998:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 6 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839704.644006:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839704.644009:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839704.644012:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7c00, rc 0) 00000100:00100000:3.0:1788839704.644071:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:11895:x1875734050183168:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 382us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839704.644078:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00080000:2.0:1788839704.644411:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788839705.407999:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839706.433660:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839706.495503:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060736896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839706.495523:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060736384:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839706.495824:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060736640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839706.497203:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060736512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.504782:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.504879:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060736768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839706.504922:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.504944:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060737408:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.504968:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.504986:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060737920:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.505008:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.505025:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060738432:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.505216:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.505263:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737408 00000100:00100000:3.0:1788839706.505270:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737408 00000100:00100000:3.0:1788839706.505317:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788839706.505326:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060737408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.505382:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060737408:12345-0@lo:400:kworker.0 Request processed in 57us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.505390:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788839706.507764:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737920 00000100:00100000:3.0:1788839706.507791:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737920 00000100:00100000:2.0:1788839706.507812:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.507865:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738432 00000100:00100000:3.0:1788839706.507869:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738432 00000100:00100000:2.0:1788839706.507879:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060737280:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.507898:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788839706.507909:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060737920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.507939:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839706.507966:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060737792:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.507976:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060737920:12345-0@lo:400:kworker.0 Request processed in 68us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.507984:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788839706.507997:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839706.508017:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060738304:0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.508053:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839706.509570:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737792 00000100:00100000:3.0:1788839706.509582:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737792 00000100:00100000:3.0:1788839706.509625:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788839706.509721:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060738432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.509812:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060738432:12345-0@lo:400:kworker.0 Request processed in 95us (4766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.509820:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788839706.509836:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788839706.509843:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060737792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.509874:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060737792:12345-0@lo:400:kworker.0 Request processed in 32us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.509880:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788839706.509915:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839706.509920:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839706.509954:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060737408:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.509967:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060737920:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.509978:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060738432:0@lo:400:kworker.0 00000100:00100000:3.0:1788839706.510028:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736384 00000100:00100000:3.0:1788839706.510032:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736384 00000100:00100000:3.0:1788839706.510062:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736768 00000100:00100000:3.0:1788839706.510065:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736768 00000100:00100000:3.0:1788839706.510075:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736896 00000100:00100000:3.0:1788839706.510078:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736896 00000100:00100000:3.0:1788839706.510089:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788839706.510095:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060736384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839706.510117:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788839706.510154:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060736384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.510172:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788839706.510185:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788839706.510190:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060736768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839706.510204:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839706.510231:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060736768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.510237:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788839706.510247:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788839706.510252:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060736896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839706.510262:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839706.510285:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060736896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839706.510290:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1788839706.510302:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839706.510325:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648289880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060736768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839706.510339:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060736384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839706.510373:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737280 00000100:00100000:3.0:1788839706.510377:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737280 00000100:00100000:1.0:1788839706.510457:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839706.510498:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060737152:0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.510530:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839706.510548:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060737664:0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.510571:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839706.510594:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060738176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.510618:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839706.510671:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736640 00000100:00100000:1.0:1788839706.510676:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736640 00000100:00100000:1.0:1788839706.510704:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788839706.510711:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060736640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839706.510733:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788839706.510768:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875734060736640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839706.510795:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788839706.510829:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060736640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839706.510856:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737152 00000100:00100000:1.0:1788839706.510860:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737152 00000100:00100000:1.0:1788839706.510886:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788839706.510892:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060737152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.510931:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060737152:12345-0@lo:400:kworker.0 Request processed in 39us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839706.510938:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788839706.510964:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060737152:0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.510993:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737664 00000100:00100000:1.0:1788839706.510996:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737664 00000100:00100000:1.0:1788839706.511020:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738176 00000100:00100000:1.0:1788839706.511023:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738176 00000100:00100000:1.0:1788839706.511039:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788839706.511045:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060737280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.511090:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060737280:12345-0@lo:400:kworker.0 Request processed in 44us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839706.511096:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788839706.511109:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788839706.511114:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060737664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.511160:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060737664:12345-0@lo:400:kworker.0 Request processed in 46us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839706.511174:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788839706.511189:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1788839706.511195:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060738176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.512371:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060738176:12345-0@lo:400:kworker.0 Request processed in 1171us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839706.512381:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00080000:1.0:1788839706.512436:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab64783e300 x1875734060737664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839706.512450:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060737664:0@lo:400:kworker.0 00010000:00080000:1.0:1788839706.512460:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647bc2d80 x1875734060738176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839706.512468:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060738176:0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.514379:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738304 00000100:00100000:1.0:1788839706.514392:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738304 00000100:00100000:2.0:1788839706.514431:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060736896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839706.514443:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839706.514451:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060738304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.514459:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060737280:0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.514484:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab74779a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060737792:0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.514516:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060738304:0@lo:400:kworker.0 00000100:00100000:1.0:1788839706.514517:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060738304:12345-0@lo:400:kworker.0 Request processed in 66us (6463us total) trans 0 rc 0/0 00000100:00080000:3.0:1788839706.514519:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839706.514527:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788839706.515336:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839706.515383:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060737024:0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515417:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839706.515439:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060737536:0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515461:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839706.515500:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060738048:0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515524:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839706.515562:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737024 00000100:00100000:0.0:1788839706.515567:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737024 00000100:00100000:0.0:1788839706.515595:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060737536 00000100:00100000:0.0:1788839706.515598:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060737536 00000100:00100000:0.0:1788839706.515616:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738048 00000100:00100000:0.0:1788839706.515618:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738048 00000100:00100000:0.0:1788839706.515630:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788839706.515636:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060737024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515685:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648289880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060737024:12345-0@lo:400:kworker.0 Request processed in 49us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839706.515691:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788839706.515703:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788839706.515709:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060737536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515728:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060737536:12345-0@lo:400:kworker.0 Request processed in 20us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839706.515734:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788839706.515742:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788839706.515747:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060738048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515764:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060738048:12345-0@lo:400:kworker.0 Request processed in 17us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839706.515786:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788839706.515813:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060737024:0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515822:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060737536:0@lo:400:kworker.0 00000100:00100000:0.0:1788839706.515829:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060738048:0@lo:400:kworker.0 00000100:00080000:3.0:1788839706.516292:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839706.518939:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060736512 00000100:00100000:2.0:1788839706.518956:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060736512 00000100:00100000:2.0:1788839706.519153:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788839706.519165:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060736512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.519270:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060736512:12345-0@lo:400:kworker.0 Request processed in 108us (3935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839706.519345:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060736512:0@lo:400:kworker.0 00000100:00100000:2.0:1788839706.519848:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788839707.010971:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060738560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839707.011046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839707.012402:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738560 00000100:00100000:3.0:1788839707.012415:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738560 00000100:00100000:3.0:1788839707.012482:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788839707.012502:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060738560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839707.012540:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788839707.012622:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060738560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839707.012628:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788839707.012814:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060738560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839707.306686:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839707.306742:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839707.307057:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183296 00000100:00100000:0.0:1788839707.307068:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183296 00000100:00100000:0.0:1788839707.307117:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 389 00000100:00100000:0.0:1788839707.307138:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050183296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839707.307213:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050183296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839707.307221:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 389 00000100:00100000:2.0:1788839707.309904:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183552 00000100:00100000:2.0:1788839707.309918:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183552 00000100:00100000:2.0:1788839707.310009:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 318 00000100:00100000:2.0:1788839707.310020:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050183552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839707.310360:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2391:x1875734050183552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 342us (3615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839707.310368:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 318 00000100:00080000:3.0:1788839707.310435:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839707.310696:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839707.310731:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839707.310796:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839707.310845:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839707.310989:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839707.311075:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050184064 00000100:00100000:2.0:1788839707.311082:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050184064 00000100:00100000:2.0:1788839707.311139:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183424 00000100:00100000:2.0:1788839707.311143:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183424 00000100:00100000:2.0:1788839707.311161:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183936 00000100:00100000:2.0:1788839707.311164:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183936 00000100:00100000:2.0:1788839707.311180:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 319 00000100:00100000:2.0:1788839707.311187:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050184064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839707.311238:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2391:x1875734050184064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 51us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839707.311244:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 319 00000100:00100000:2.0:1788839707.311260:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 320 00000100:00100000:2.0:1788839707.311265:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+14:2392:x1875734050183424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839707.311290:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+14:2392:x1875734050183424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839707.311296:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 320 00000100:00100000:2.0:1788839707.311306:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 321 00000100:00100000:2.0:1788839707.311311:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+6:2392:x1875734050183936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839707.311328:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+6:2392:x1875734050183936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 18us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839707.311333:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 321 00000100:00080000:1.0:1788839707.311615:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839707.311619:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839707.311687:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183808 00000100:00100000:3.0:1788839707.311692:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183808 00000100:00100000:3.0:1788839707.311741:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050183680 00000100:00100000:3.0:1788839707.311745:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050183680 00000100:00100000:3.0:1788839707.311799:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1788839707.311812:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050183808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839707.311849:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050183808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839707.311855:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1788839707.311868:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:3.0:1788839707.311874:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050183680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839707.311899:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050183680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839707.311905:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00080000:1.0:1788839707.312020:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839707.312033:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788839707.459332:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839708.036549:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788839708.036566:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788839708.036735:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788839708.036746:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1788839708.036989:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00010000:00010000:1.0:1788839708.481602:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839708.790467:0:14477:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:55:06 (1788839706) 00000100:00100000:3.0:1788839709.056001:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839709.056023:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060738688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788839709.056088:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839709.056191:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738688 00000100:00100000:1.0:1788839709.056199:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738688 00000100:00100000:1.0:1788839709.056245:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788839709.056256:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060738688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839709.056287:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839709.056331:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060738688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839709.056339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788839709.056382:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060738688:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839709.511469:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839710.198873:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839710.199047:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050184320 00000100:00100000:2.0:1788839710.199057:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050184320 00000100:00100000:2.0:1788839710.199137:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:2.0:1788839710.199148:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+13:12162:x1875734050184320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839710.199169:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839710.199190:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573516 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a00 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199261:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199293:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199305:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199320:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199327:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199333:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199428:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657352b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199437:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657352b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199443:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657352b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839710.199453:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788839710.199546:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199554:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199561:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199573:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839710.199579:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199586:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199598:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647850000) 00010000:00010000:2.0:1788839710.199601:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839710.199606:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199611:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a2657351d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199636:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199643:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199648:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199653:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839710.199656:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199661:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199682:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab646801900) 00010000:00010000:2.0:1788839710.199684:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839710.199687:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.199693:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573524 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.200606:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a26573516 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a00 expref: 16 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.200640:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657352b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a00 expref: 15 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839710.200648:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839710.200650:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839710.200653:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843200, rc 0) 00000100:00100000:2.0:1788839710.200726:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648289180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+15:12162:x1875734050184320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1579us (1862us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788839710.200735:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00080000:1.0:1788839710.200972:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839710.204575:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839710.204642:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839710.204965:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050184448 00000100:00100000:2.0:1788839710.204976:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050184448 00000100:00100000:2.0:1788839710.205045:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:2.0:1788839710.205055:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+15:12162:x1875734050184448:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788839710.205207:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+15:12162:x1875734050184448:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 152us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839710.205215:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:0.0:1788839710.205806:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050184576 00000100:00100000:0.0:1788839710.205812:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050184576 00000100:00100000:0.0:1788839710.205854:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788839710.205863:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+15:2392:x1875734050184576:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839710.205875:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839710.205898:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a2657352b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a00 expref: 15 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839710.205916:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:0.0:1788839710.205921:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839710.205950:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+14:2392:x1875734050184576:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 88us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839710.205965:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1788839710.210838:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839710.211130:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050184704 00000100:00100000:3.0:1788839710.211140:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050184704 00000100:00100000:3.0:1788839710.211276:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:3.0:1788839710.211287:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:12162:x1875734050184704:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788839710.211391:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648289f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:12162:x1875734050184704:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 105us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839710.211398:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00080000:1.0:1788839710.211455:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788839710.401440:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788839710.527001:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839710.912037:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839710.912046:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839710.912522:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788839710.912534:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788839711.551104:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839711.615635:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839711.615713:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.615819:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738816 00000100:00100000:1.0:1788839711.615833:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738816 00000100:00100000:1.0:1788839711.615883:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788839711.615890:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060738816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839711.615914:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788839711.615955:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060738816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.615961:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788839711.615978:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839711.616138:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060738944:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.616212:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060739456:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616236:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.616252:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060739968:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616272:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.616291:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788839711.616296:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060739072:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616317:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.616336:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060739584:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616367:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.616392:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060740096:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616420:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.616457:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060738944 00000100:00100000:1.0:1788839711.616461:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060738944 00000100:00100000:1.0:1788839711.616494:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788839711.616502:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060738944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616540:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060738944:12345-0@lo:400:kworker.0 Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.616554:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788839711.616588:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739968 00000100:00100000:1.0:1788839711.616592:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739968 00000100:00100000:1.0:1788839711.616637:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788839711.616645:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060739968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616680:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060739968:12345-0@lo:400:kworker.0 Request processed in 37us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.616685:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788839711.616704:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739072 00000100:00100000:1.0:1788839711.616707:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739072 00000100:00100000:1.0:1788839711.616729:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739584 00000100:00100000:1.0:1788839711.616731:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739584 00000100:00100000:1.0:1788839711.616748:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740096 00000100:00100000:1.0:1788839711.616750:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740096 00000100:00100000:1.0:1788839711.616765:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788839711.616796:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060739072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616826:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060739072:12345-0@lo:400:kworker.0 Request processed in 55us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.616832:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788839711.616844:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788839711.616849:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060739584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616876:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060739584:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.616881:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1788839711.616892:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788839711.616897:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060740096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616934:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060740096:12345-0@lo:400:kworker.0 Request processed in 37us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.616940:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788839711.616971:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060739200:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.616995:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.617013:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060739712:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617030:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.617044:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060740224:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.617077:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788839711.617082:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060739328:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617106:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.617123:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060739840:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617143:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.617159:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060740352:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617181:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.617211:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739456 00000100:00100000:1.0:1788839711.617215:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739456 00000100:00100000:1.0:1788839711.617239:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739200 00000100:00100000:1.0:1788839711.617242:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739200 00000100:00100000:1.0:1788839711.617254:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788839711.617260:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060739456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617306:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060739456:12345-0@lo:400:kworker.0 Request processed in 46us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.617312:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788839711.617333:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788839711.617339:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060739200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617373:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648304a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060739200:12345-0@lo:400:kworker.0 Request processed in 35us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.617379:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788839711.617399:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739712 00000100:00100000:1.0:1788839711.617402:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739712 00000100:00100000:1.0:1788839711.617430:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740224 00000100:00100000:1.0:1788839711.617434:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740224 00000100:00100000:1.0:1788839711.617451:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739328 00000100:00100000:1.0:1788839711.617454:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739328 00000100:00100000:3.0:1788839711.617458:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060739840 00000100:00100000:3.0:1788839711.617465:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060739840 00000100:00100000:1.0:1788839711.617472:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788839711.617481:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060739712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839711.617510:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740352 00000100:00100000:3.0:1788839711.617515:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740352 00000100:00100000:1.0:1788839711.617517:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060739712:12345-0@lo:400:kworker.0 Request processed in 37us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.617525:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788839711.617543:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788839711.617548:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788839711.617553:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060740224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839711.617562:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060739840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617586:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060740224:12345-0@lo:400:kworker.0 Request processed in 37us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.617594:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788839711.617623:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788839711.617627:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060739840:12345-0@lo:400:kworker.0 Request processed in 67us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.617635:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060739328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839711.617641:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788839711.617661:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788839711.617670:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060740352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617676:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648304e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060739328:12345-0@lo:400:kworker.0 Request processed in 42us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839711.617683:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:1.0:1788839711.617709:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839711.617716:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648306a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060740352:12345-0@lo:400:kworker.0 Request processed in 48us (532us total) trans 0 rc 0/0 00000100:00080000:1.0:1788839711.617721:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839711.617725:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788839711.617725:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839711.617731:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839711.617760:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788839711.617765:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab647bb6680, transno 4294967313 00000100:00100000:1.0:1788839711.617805:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060738816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839711.617941:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060739328:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617953:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648264380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060739840:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617961:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060740352:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.617969:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060739200:0@lo:400:kworker.0 00010000:00080000:1.0:1788839711.617979:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab64783e300 x1875734060739712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839711.617987:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060739712:0@lo:400:kworker.0 00010000:00080000:1.0:1788839711.617996:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab648267100 x1875734060740224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839727 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839711.618003:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060740224:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618030:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060740480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839711.618057:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.618082:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060739072:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618094:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060739584:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618103:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060740096:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618113:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060738944:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618132:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060739456:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618142:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060739968:0@lo:400:kworker.0 00000100:00100000:1.0:1788839711.618209:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839711.618215:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060740608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839711.618237:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839711.618261:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740480 00000100:00100000:1.0:1788839711.618265:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740480 00000100:00100000:1.0:1788839711.618288:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740608 00000100:00100000:1.0:1788839711.618292:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740608 00000100:00100000:1.0:1788839711.618306:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788839711.618313:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77fba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060740480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788839711.618327:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788839711.618365:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77fba2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060740480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839711.618371:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788839711.618385:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788839711.618386:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060740608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839711.618407:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839711.618450:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648306680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060740608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839711.618458:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788839711.620436:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839711.620454:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060740736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839711.620509:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839711.620550:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740736 00000100:00100000:2.0:1788839711.620556:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740736 00000100:00100000:2.0:1788839711.620596:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788839711.620604:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060740736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839711.620635:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839711.620676:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060740736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839711.620683:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788839711.620722:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060740736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839711.620812:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060740608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839711.620848:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060740480:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839712.129997:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839712.130023:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060740864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839712.130092:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839712.130210:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060740864 00000100:00100000:3.0:1788839712.130218:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060740864 00000100:00100000:3.0:1788839712.130269:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788839712.130279:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060740864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839712.130311:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788839712.130367:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060740864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839712.130374:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788839712.130449:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060740864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839712.168336:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.168418:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050184832 00000100:00100000:3.0:1788839712.168427:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050184832 00000100:00100000:3.0:1788839712.168501:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:3.0:1788839712.168511:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+14:12205:x1875734050184832:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839712.168533:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839712.168553:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a07 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168635:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168651:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168664:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168679:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168685:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168704:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168758:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168766:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168796:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168802:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839712.168806:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168814:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168826:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839712.168829:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839712.168833:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168838:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a26573540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168849:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168854:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168865:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168869:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839712.168872:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168877:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168885:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab747cc7900) 00010000:00010000:3.0:1788839712.168888:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839712.168890:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168895:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573547 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168925:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573539 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a07 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168935:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839712.168937:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839712.168940:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a26573539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a07 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.168950:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6600, rc 0) 00000100:00100000:3.0:1788839712.169003:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+14:12205:x1875734050184832:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 494us (675us total) trans 0 rc 301/301 00000100:00100000:3.0:1788839712.169018:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00080000:1.0:1788839712.169184:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839712.181471:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.181539:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185088 00000100:00100000:1.0:1788839712.181549:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185088 00000100:00100000:1.0:1788839712.182177:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788839712.182189:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+14:12205:x1875734050185088:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1788839712.182254:0:12241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839712.182281:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a26572e8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7482b expref: 14 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.182298:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:1.0:1788839712.182303:0:12241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839712.182362:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.182375:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.182383:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.182415:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 5 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.182428:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 5 pid: 6488 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839712.182442:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648305500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060740992:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839712.182523:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839712.186108:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839712.186143:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185216 00000100:00100000:0.0:1788839712.186152:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185216 00010000:00010000:0.0:1788839712.186201:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 6 pid: 6488 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839712.186235:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:0.0:1788839712.186244:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2390:x1875734050185216:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839712.186258:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839712.186265:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 6 pid: 6488 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.186277:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 6 pid: 6488 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.186300:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:0.0:1788839712.186305:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.186314:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.186322:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.186350:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839712.186398:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:369e11fa-e360-4215-b9ed-184f44a2087d+6:2390:x1875734050185216:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 155us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839712.186406:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00080000:0.0:1788839712.186430:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839712.186837:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657350f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f9 expref: 5 pid: 6488 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839712.186854:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648305500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060740992:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839712.186873:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.186881:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.186887:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.186908:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.186918:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.186927:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187437:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187447:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187454:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839712.187476:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf2652ce reply state 00000000e8f29d7b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187486:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187492:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839712.187494:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839712.187497:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788839712.187502:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788839712.187508:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187514:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187519:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187524:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839712.187528:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187534:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187541:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab647851b00) 00010000:00010000:3.0:1788839712.187544:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839712.187546:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187561:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657354e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839712.187575:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf2652ce reply state 00000000e8f29d7b transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.187584:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.188005:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab747cc7900) 00010000:00010000:3.0:1788839712.188010:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839712.188013:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788839712.188094:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+15:12205:x1875734050185088:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 5906us (6629us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788839712.188102:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1788839712.297974:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.298063:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185344 00000100:00100000:2.0:1788839712.298073:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185344 00000100:00100000:2.0:1788839712.298139:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:2.0:1788839712.298151:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+15:12213:x1875734050185344:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1788839712.298175:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839712.298199:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a0e expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.298269:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657356a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.298282:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657356a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.298294:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657356a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839712.298357:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839712.298361:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839712.298382:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657356a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.298405:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a0e expref: 17 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.298423:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657356a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a0e expref: 16 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.298432:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:2.0:1788839712.298435:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839712.298439:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843400, rc 0) 00000100:00100000:2.0:1788839712.298500:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+16:12213:x1875734050185344:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 351us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.298508:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:0.0:1788839712.392942:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.393011:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185472 00000100:00100000:1.0:1788839712.393021:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185472 00000100:00100000:1.0:1788839712.393085:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:1.0:1788839712.393096:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64828ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+16:12219:x1875734050185472:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839712.393130:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839712.393152:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a26573571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a15 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393230:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393246:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393257:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393267:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393275:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393281:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393362:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26573586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393370:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26573586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393378:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26573586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839712.393412:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788839712.393421:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839712.393443:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26573586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393455:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393462:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393469:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393475:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.393478:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393486:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393498:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:1.0:1788839712.393501:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.393505:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393511:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393522:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393527:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393544:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393549:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.393552:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393557:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393563:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab747cc7900) 00010000:00010000:1.0:1788839712.393565:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.393568:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393574:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657357f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393599:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a26573571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a15 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393626:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26573586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a15 expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.393633:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839712.393635:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788839712.393638:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958000, rc 0) 00000100:00100000:1.0:1788839712.393705:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64828ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+17:12219:x1875734050185472:12345-192.168.203.52@tcp:101:bash.0 Request processed in 611us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839712.393720:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:0.0:1788839712.399493:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.400188:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185728 00000100:00100000:3.0:1788839712.400199:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185728 00000100:00100000:3.0:1788839712.400266:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:3.0:1788839712.400277:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+17:12219:x1875734050185728:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839712.400301:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839712.400324:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657358d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a1c expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.400431:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.400446:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.400475:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.400537:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.400546:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.400552:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788839712.401158:0:12241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788839712.401300:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401312:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401319:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401354:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401360:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401367:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401373:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839712.401384:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401392:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401404:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839712.401407:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839712.401411:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401417:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573594 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839712.401434:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7321e45 reply state 000000007d607caa transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401445:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401451:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:3.0:1788839712.401453:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839712.401455:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788839712.401489:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657358d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 20 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401503:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 19 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.401510:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:3.0:1788839712.401512:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839712.401521:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6800, rc 0) 00000100:00100000:3.0:1788839712.401942:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+20:12219:x1875734050185728:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1664us (2457us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788839712.401951:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:0.0:1788839712.412060:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.412152:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185856 00000100:00100000:1.0:1788839712.412162:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185856 00000100:00100000:1.0:1788839712.412230:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1788839712.412241:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050185856:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839712.412259:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839712.412279:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a23 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839712.412303:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839712.412322:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788839712.412328:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839712.412337:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 6 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.412354:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 6 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.412366:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958c00, rc 0) 00000100:00100000:1.0:1788839712.412432:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050185856:12345-192.168.203.52@tcp:101:bash.0 Request processed in 193us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839712.412438:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00080000:0.0:1788839712.412923:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839712.415461:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.415544:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050185984 00000100:00100000:3.0:1788839712.415555:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050185984 00000100:00100000:3.0:1788839712.415623:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1788839712.415635:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:12219:x1875734050185984:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839712.415653:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839712.415674:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a2a expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.415706:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 7 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.415716:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839712.415730:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839712.415736:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.415811:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 7 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.415825:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 7 pid: 8539 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839712.415839:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875734060741120:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839712.415946:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab762c843c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839712.423239:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839712.423339:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050186112 00000100:00100000:0.0:1788839712.423350:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050186112 00010000:00010000:0.0:1788839712.423391:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 8 pid: 8539 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839712.423438:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788839712.423447:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050186112:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839712.423463:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839712.423486:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 8 pid: 8539 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.423501:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 8 pid: 8539 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.423525:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839712.423530:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839712.423553:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.423563:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.423623:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839712.423638:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6474:1875734060741248:192.168.203.52@tcp:105: 00000100:00100000:0.0:1788839712.423732:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788839712.424337:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be83c9f1/0xad5b343a265735b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a23 expref: 8 pid: 8539 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839712.424356:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875734060741120:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839712.424380:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 7 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.424391:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6600, rc 0) 00000100:00100000:3.0:1788839712.424438:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:12219:x1875734050185984:12345-192.168.203.52@tcp:101:bash.0 Request processed in 8805us (8984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839712.424445:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788839712.430676:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.430716:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.430761:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.430832:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.430863:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050186496 00000100:00100000:2.0:1788839712.430874:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050186496 00000100:00100000:2.0:1788839712.430932:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1788839712.430943:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050186496:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839712.431019:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2392:x1875734050186496:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.431041:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00080000:2.0:1788839712.431062:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839712.431223:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050186240 00000100:00100000:1.0:1788839712.431228:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050186240 00000100:00100000:1.0:1788839712.431266:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 391 00000100:00100000:1.0:1788839712.431272:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050186240:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839712.431315:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e5b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2392:x1875734050186240:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839712.431322:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 391 00000100:00100000:3.0:1788839712.431424:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050186368 00000100:00100000:3.0:1788839712.431429:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050186368 00000100:00100000:3.0:1788839712.431458:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050186624 00000100:00100000:3.0:1788839712.431461:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050186624 00000100:00100000:3.0:1788839712.431476:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 328 00000100:00100000:3.0:1788839712.431481:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050186368:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839712.431512:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2392:x1875734050186368:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839712.431518:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 328 00000100:00100000:3.0:1788839712.431528:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 329 00000100:00100000:3.0:1788839712.431534:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050186624:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839712.431552:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2392:x1875734050186624:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 18us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839712.431566:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 329 00000100:00080000:1.0:1788839712.431706:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839712.439673:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.439805:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050186880 00000100:00100000:3.0:1788839712.439816:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050186880 00000100:00100000:3.0:1788839712.439874:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788839712.439885:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+20:12219:x1875734050186880:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1788839712.440168:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12219:x1875734050186880:12345-192.168.203.52@tcp:35:bash.0 Request processed in 284us (505us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788839712.440176:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788839712.440936:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7443db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6474:1875734060741248:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788839712.440960:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839712.441000:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2389:x1875734050186112:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 17554us (17774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839712.441010:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1788839712.558963:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.559059:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050187136 00000100:00100000:3.0:1788839712.559069:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050187136 00000100:00100000:3.0:1788839712.559138:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:3.0:1788839712.559149:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12229:x1875734050187136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839712.559174:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839712.559195:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265735be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a31 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839712.559292:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788839712.559390:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265735be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a31 expref: 23 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.559406:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:3.0:1788839712.559409:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839712.559413:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265735be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a31 expref: 23 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.559428:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7400, rc 0) 00000100:00100000:3.0:1788839712.559508:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:12229:x1875734050187136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 360us (555us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788839712.559516:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:2.0:1788839712.563084:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.563165:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050187392 00000100:00100000:3.0:1788839712.563175:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050187392 00000100:00100000:3.0:1788839712.563230:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1788839712.563240:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+22:12229:x1875734050187392:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839712.563472:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+23:12229:x1875734050187392:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 233us (401us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788839712.563480:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00010000:00010000:1.0:1788839712.576086:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839712.699205:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.699299:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050187520 00000100:00100000:1.0:1788839712.699309:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050187520 00000100:00100000:1.0:1788839712.699367:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:1.0:1788839712.699377:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+23:12235:x1875734050187520:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839712.699401:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839712.699420:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265735cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a38 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.699482:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265735d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.699496:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265735d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.699507:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265735d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839712.699547:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788839712.699550:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839712.699567:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265735d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.699592:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265735cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a38 expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.699652:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265735d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a38 expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.699661:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839712.699664:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839712.699667:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959e00, rc 0) 00000100:00100000:1.0:1788839712.699730:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+24:12235:x1875734050187520:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 355us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839712.699737:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:0.0:1788839712.706666:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.707616:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050187776 00000100:00100000:1.0:1788839712.707628:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050187776 00000100:00100000:1.0:1788839712.707706:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:1.0:1788839712.707716:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+24:12235:x1875734050187776:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839712.707738:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839712.707760:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265735da lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a3f expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.707908:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265735e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.707923:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265735e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.707932:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265735e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839712.707943:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788839712.708071:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265735da lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a3f expref: 27 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.708091:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265735e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a3f expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.708098:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:1.0:1788839712.708101:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839712.708104:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958400, rc 0) 00000100:00100000:1.0:1788839712.708165:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+26:12235:x1875734050187776:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 451us (1510us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788839712.708172:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:3.0:1788839712.712258:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.712303:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.712388:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050187904 00000100:00100000:2.0:1788839712.712397:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050187904 00000100:00100000:2.0:1788839712.712471:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788839712.712481:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+26:2389:x1875734050187904:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839712.712496:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839712.712520:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265735e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a3f expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.712538:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:2.0:1788839712.712543:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839712.712923:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+25:2389:x1875734050187904:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 443us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.712931:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1788839712.713059:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050188160 00000100:00100000:1.0:1788839712.713064:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050188160 00000100:00100000:1.0:1788839712.713095:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:1.0:1788839712.713103:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12235:x1875734050188160:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839712.713124:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839712.713139:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a265735ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a46 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.713229:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a265735f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.713243:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a265735f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.713252:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a265735f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839712.713282:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788839712.713376:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a265735ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a46 expref: 28 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.713390:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a265735f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a46 expref: 27 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.713396:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:1.0:1788839712.713398:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788839712.713401:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959a00, rc 0) 00000100:00100000:1.0:1788839712.713428:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12235:x1875734050188160:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 326us (1125us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788839712.713434:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:0.0:1788839712.723840:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.724110:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050188288 00000100:00100000:3.0:1788839712.724120:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050188288 00000100:00100000:3.0:1788839712.724230:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1788839712.724241:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2391:x1875734050188288:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1788839712.724283:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.724303:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 6 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.724311:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839712.724315:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839712.724319:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.724374:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 6 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.724387:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 6 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839712.724400:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1875734060741376:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839712.724499:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab762c843c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839712.728361:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8403:1875734060741376:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839712.728395:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839712.729239:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.729444:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050188416 00000100:00100000:3.0:1788839712.729452:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050188416 00002000:00100000:3.0:1788839712.729560:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ab6483ddc00 x1875734050188416/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:103/0 lens 504/0 e 0 to 0 dl 1788839723 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839712.729570:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6483ddc00 with x1875734050188416 ext(0->12) 00010000:00010000:3.0:1788839712.729578:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 7 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.729648:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 7 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839712.729657:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab6483ddc00 00000100:00100000:3.0:1788839712.729857:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788839712.729868:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050188416:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:3.0:1788839712.730968:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050188416:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 1097us (1726us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788839712.730992:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:3.0:1788839712.731002:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8ab6483ddc00 x1875734050188416/t4294967306(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:103/0 lens 504/448 e 0 to 0 dl 1788839723 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788839712.731012:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab6483ddc00 with x1875734050188416 ext(0->12) 00010000:00010000:3.0:1788839712.731019:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 9 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.731036:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 9 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839712.731043:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab6483ddc00 00000100:00100000:0.0:1788839712.733968:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.734031:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050188544 00000100:00100000:2.0:1788839712.734041:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050188544 00010000:00010000:2.0:1788839712.734079:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 9 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839712.734119:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1788839712.734128:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2391:x1875734050188544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839712.734153:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788839712.734170:0:8419:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788839712.734172:0:8419:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788839711 00002000:00010000:2.0:1788839712.734175:0:8419:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788839712 00002000:00010000:2.0:1788839712.734177:0:8419:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788839711 00002000:00010000:2.0:1788839712.734179:0:8419:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788839712.734185:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 9 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.734197:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 9 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.734219:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012127099/0xad5b343a265735b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a2a expref: 9 pid: 8404 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.734236:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839712.734241:0:8419:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839712.734246:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.734256:0:8419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.734287:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839712.734349:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2391:x1875734050188544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 221us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.734357:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00010000:00010000:0.0:1788839712.734359:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734377:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734398:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734406:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734413:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734419:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839712.734423:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734431:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734442:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.734449:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5403f3b/0xad5b343a26573604 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839712.734502:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2391:x1875734050188288:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 10262us (10671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839712.734510:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1788839712.737069:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.737145:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050188800 00000100:00100000:3.0:1788839712.737153:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050188800 00000100:00100000:3.0:1788839712.737207:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1788839712.737217:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12235:x1875734050188800:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1788839712.737280:0:6491:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a265735f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a46 expref: 27 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839712.737557:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788839712.737672:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788839712.738418:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1788839712.738520:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.738538:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 31 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.738548:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.738582:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 31 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.739008:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 31 pid: 12241 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839712.739023:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875734060741504:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839712.739099:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839712.741361:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875734060741504:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839712.741395:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839712.741870:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.742045:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050188928 00000100:00100000:2.0:1788839712.742051:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050188928 00010000:00010000:2.0:1788839712.742085:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 32 pid: 12241 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839712.742124:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:2.0:1788839712.742133:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+32:2390:x1875734050188928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839712.742159:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839712.742166:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 32 pid: 12241 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.742178:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 32 pid: 12241 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.742198:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a265735a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a1c expref: 32 pid: 12241 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.742211:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:2.0:1788839712.742214:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.742221:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.742226:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.742351:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839712.742394:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+31:2390:x1875734050188928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 262us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.742406:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00010000:00010000:3.0:1788839712.742713:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.742723:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839712.742887:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788839712.743005:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788839712.743105:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060741632:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839712.743141:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839712.743176:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839712.743188:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060741632 00000100:00100000:3.0:1788839712.743200:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060741632 00000100:00100000:2.0:1788839712.743346:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788839712.743354:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1875734060741632:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839712.743429:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6491:x1875734060741632:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.743436:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788839712.743533:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483de300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060741632:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788839712.743658:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788839712.743719:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7477d9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060741760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788839712.743747:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839712.743794:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96540 going to sleep for 11 seconds 00000100:00100000:1.0:1788839712.743803:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060741760 00000100:00100000:1.0:1788839712.743808:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060741760 00000100:00100000:1.0:1788839712.743843:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788839712.743850:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7477db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6491:x1875734060741760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788839712.743946:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7477db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1875734060741760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (197us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788839712.743953:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788839712.744006:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7477d9180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060741760:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788839712.744041:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788839712.744071:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.744080:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.744087:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.744093:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839712.744097:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.744105:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.744127:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:0.0:1788839712.744129:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788839712.744133:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839712.744139:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a2657360b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788839712.744225:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788839712.744281:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788839712.744293:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367688521597ns, next at 368688519782ns, rc = 0 00000001:00080000:0.0:1788839712.744298:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788839712.744318:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab747cc7700) 00010000:00010000:0.0:1788839712.744321:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788839712.744327:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a265735f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a46 expref: 35 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839712.744408:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+34:12235:x1875734050188800:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 7192us (7348us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788839712.744416:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000020:00080000:0.0:1788839712.744420:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788839712.747151:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.747263:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050189056 00000100:00100000:2.0:1788839712.747273:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050189056 00000100:00100000:2.0:1788839712.747323:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:2.0:1788839712.747333:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+34:12235:x1875734050189056:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839712.747357:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839712.747379:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573612 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a4d expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.747433:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a4d expref: 35 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.747446:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573612 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a4d expref: 35 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839712.747464:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:2.0:1788839712.747467:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839712.747471:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843600, rc 0) 00000100:00100000:2.0:1788839712.747527:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+35:12235:x1875734050189056:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 196us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839712.747533:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:3.0:1788839712.754182:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839712.756515:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050189312 00000100:00100000:2.0:1788839712.756542:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050189312 00000100:00100000:2.0:1788839712.756630:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1788839712.756642:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+35:12235:x1875734050189312:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839712.757301:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+36:12235:x1875734050189312:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 659us (3126us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788839712.757310:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1788839712.902013:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.902103:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050189568 00000100:00100000:3.0:1788839712.902112:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050189568 00000100:00100000:3.0:1788839712.902174:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:3.0:1788839712.902185:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+36:12245:x1875734050189568:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839712.902208:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839712.902228:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a54 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839712.902317:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788839712.902411:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573619 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a54 expref: 38 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.902426:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:3.0:1788839712.902429:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839712.902435:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a54 expref: 38 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.902450:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078000, rc 0) 00000100:00100000:3.0:1788839712.902512:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12245:x1875734050189568:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 329us (511us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788839712.902518:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:0.0:1788839712.915713:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.915959:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050189696 00000100:00100000:1.0:1788839712.915970:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050189696 00000100:00100000:1.0:1788839712.916026:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:1.0:1788839712.916037:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12245:x1875734050189696:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1788839712.916114:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916144:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916155:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916167:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916174:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916180:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916256:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916263:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916269:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839712.916313:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916326:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916331:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916348:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916354:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.916358:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916365:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916376:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839712.916379:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.916383:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916388:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573627 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916400:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916405:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916410:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916414:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.916418:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916432:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916440:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:1.0:1788839712.916442:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.916445:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916449:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657362e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916458:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916463:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916467:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916471:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.916474:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916479:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916484:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839712.916487:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.916490:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.916504:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573635 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839712.916577:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12245:x1875734050189696:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 541us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839712.916593:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:2.0:1788839712.923104:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839712.923391:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050189952 00000100:00100000:0.0:1788839712.923401:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050189952 00000100:00100000:0.0:1788839712.923462:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:0.0:1788839712.923472:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12245:x1875734050189952:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839712.923854:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+38:12245:x1875734050189952:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 381us (755us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788839712.923863:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:0.0:1788839712.975546:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839712.975760:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050190208 00000100:00100000:1.0:1788839712.975801:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050190208 00000100:00100000:1.0:1788839712.975861:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:1.0:1788839712.975872:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+38:12248:x1875734050190208:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839712.975894:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839712.975914:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657363c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a5b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.975983:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.975997:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976008:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976019:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976025:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976048:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976149:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976157:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976165:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839712.976174:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788839712.976245:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976252:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976258:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976263:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.976267:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976274:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976286:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839712.976289:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.976299:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976306:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573643 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976320:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976326:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976332:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976337:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839712.976340:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976346:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976353:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:1.0:1788839712.976356:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839712.976359:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976365:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657364a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976401:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a2657363c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976427:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 40 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839712.976434:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839712.976437:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839712.976439:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959a00, rc 0) 00000100:00100000:1.0:1788839712.976763:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+40:12248:x1875734050190208:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 893us (1226us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788839712.976810:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:0.0:1788839712.987503:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839712.987596:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050190336 00000100:00100000:3.0:1788839712.987613:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050190336 00000100:00100000:3.0:1788839712.987701:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:3.0:1788839712.987719:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+40:12248:x1875734050190336:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1788839712.987809:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987839:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987851:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987886:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987893:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987900:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987908:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839712.987912:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987919:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987929:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839712.987932:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839712.987936:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839712.987943:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a2657365f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839712.988019:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+40:12248:x1875734050190336:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 309us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839712.988033:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:2.0:1788839712.990704:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839712.990914:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050190592 00000100:00100000:0.0:1788839712.990925:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050190592 00000100:00100000:0.0:1788839712.990979:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1788839712.990989:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+40:12248:x1875734050190592:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839712.991248:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+41:12248:x1875734050190592:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 217us (511us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788839712.991257:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788839713.223736:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.223877:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050190848 00000100:00100000:0.0:1788839713.223888:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050190848 00000100:00100000:0.0:1788839713.223951:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:0.0:1788839713.223962:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+41:12279:x1875734050190848:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1788839713.223987:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839713.224009:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26573666 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a62 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.224117:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a2657366d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.224131:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a2657366d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.224143:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a2657366d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839713.224168:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788839713.224276:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a26573666 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a62 expref: 44 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.224294:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a2657366d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a62 expref: 43 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.224302:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839713.224305:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839713.224309:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc400, rc 0) 00000100:00100000:0.0:1788839713.224368:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12279:x1875734050190848:12345-192.168.203.52@tcp:101:cat.0 Request processed in 407us (641us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788839713.224376:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:1.0:1788839713.229651:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.229733:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050191104 00000100:00100000:0.0:1788839713.229742:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050191104 00000100:00100000:0.0:1788839713.229838:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1788839713.229848:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12279:x1875734050191104:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1788839713.230103:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+44:12279:x1875734050191104:12345-192.168.203.52@tcp:35:cat.0 Request processed in 255us (459us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788839713.230110:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788839713.237570:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.238011:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050191232 00000100:00100000:0.0:1788839713.238022:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050191232 00000100:00100000:0.0:1788839713.238091:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1788839713.238102:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+44:2392:x1875734050191232:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839713.238117:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839713.238163:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a2657366d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a62 expref: 44 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.238180:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839713.238185:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839713.238437:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+43:2392:x1875734050191232:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 337us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839713.238447:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1788839713.277727:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839713.278007:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050191488 00000100:00100000:1.0:1788839713.278019:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050191488 00000100:00100000:1.0:1788839713.278129:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1788839713.278141:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12285:x1875734050191488:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1788839713.278167:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839713.278170:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788839713.278197:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265735d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a38 expref: 43 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.278217:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839713.278223:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839713.278236:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657367b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a69 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.278353:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.278379:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.278389:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.278422:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.278435:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 43 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839713.278449:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648304000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060741888:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839713.278939:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839713.287838:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648304000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060741888:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839713.287868:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839713.292740:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839713.293578:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050191616 00000100:00100000:1.0:1788839713.293917:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050191616 00010000:00010000:1.0:1788839713.293960:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 44 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839713.294043:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1788839713.294054:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+44:2390:x1875734050191616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839713.294068:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839713.294074:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 44 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.294088:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 44 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.294122:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a26573651 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a5b expref: 44 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.294137:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839713.294142:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.294152:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.294160:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.294192:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839713.294247:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d09450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+43:2390:x1875734050191616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 195us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839713.294254:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00010000:00010000:2.0:1788839713.294347:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839713.294356:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839713.294375:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788839713.294500:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657367b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839713.294515:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839713.294523:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:2.0:1788839713.294526:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839713.294529:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959600, rc 0) 00000100:00100000:2.0:1788839713.294552:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12285:x1875734050191488:12345-192.168.203.52@tcp:101:dd.0 Request processed in 16414us (16837us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788839713.294570:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1788839713.298890:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839713.299072:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050191744 00000100:00100000:3.0:1788839713.299081:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050191744 00000100:00100000:3.0:1788839713.299143:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788839713.299153:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12285:x1875734050191744:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1788839713.299178:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839713.299199:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573690 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a70 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.299232:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.299247:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.299257:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.299477:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573690 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 45 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.299496:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 44 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.299504:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839713.299507:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839713.299517:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078200, rc 0) 00000100:00100000:3.0:1788839713.299614:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+44:12285:x1875734050191744:12345-192.168.203.52@tcp:101:dd.0 Request processed in 462us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839713.299622:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:3.0:1788839713.304977:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839713.305184:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050192000 00000100:00100000:1.0:1788839713.305194:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050192000 00000100:00100000:1.0:1788839713.305248:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:1.0:1788839713.305258:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+44:12285:x1875734050192000:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:1.0:1788839713.305483:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.305499:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.305510:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839713.305563:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788839713.305606:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000068ccc1ee reply state 00000000bbfea438 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.305619:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.305626:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839713.305629:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839713.305633:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839713.305723:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+47:12285:x1875734050192000:12345-192.168.203.52@tcp:36:dd.0 Request processed in 467us (758us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788839713.305731:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00000020:00080000:1.0:1788839713.305736:0:12241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788839713.585267:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.585376:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050192128 00000100:00100000:0.0:1788839713.585385:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050192128 00000100:00100000:0.0:1788839713.585444:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:0.0:1788839713.585454:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+47:12299:x1875734050192128:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1788839713.585478:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839713.585499:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265736a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a77 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585568:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585583:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585611:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585640:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585648:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585654:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585731:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585742:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585750:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585817:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.585831:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 48 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839713.585844:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7450e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060742016:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839713.585933:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839713.592485:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7450e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060742016:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839713.592606:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839713.593811:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.593916:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050192384 00000100:00100000:0.0:1788839713.593925:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050192384 00000100:00100000:0.0:1788839713.593989:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1788839713.593999:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+49:6163:x1875734050192384:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788839713.594307:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+50:6163:x1875734050192384:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 309us (501us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788839713.594315:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788839713.596919:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.597077:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050192512 00000100:00100000:0.0:1788839713.597087:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050192512 00010000:00010000:0.0:1788839713.597127:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 50 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839713.597172:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1788839713.597182:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+50:2391:x1875734050192512:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839713.597196:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839713.597203:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 50 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.597216:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 50 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.597238:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573682 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a69 expref: 50 pid: 6488 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.597255:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839713.597285:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.597296:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.597303:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.597336:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839713.597388:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+49:2391:x1875734050192512:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 207us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839713.597396:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00010000:00010000:1.0:1788839713.597845:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.597855:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839713.597910:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788839713.597914:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839713.597937:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.597952:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.597961:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.597989:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.597995:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598002:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839713.598008:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598016:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598029:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839713.598032:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839713.598036:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598041:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a265736ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598055:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598061:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598067:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598072:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfca00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839713.598082:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598088:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598097:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:1.0:1788839713.598100:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839713.598103:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598108:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a265736b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598147:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265736a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a77 expref: 49 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598163:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a77 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.598169:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839713.598172:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839713.598174:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfce00, rc 0) 00000100:00100000:1.0:1788839713.598235:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+48:12299:x1875734050192128:12345-192.168.203.52@tcp:101:stat.0 Request processed in 12781us (12978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839713.598242:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00010000:00010000:2.0:1788839713.599428:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839713.708079:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839713.709684:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050192768 00000100:00100000:3.0:1788839713.709698:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050192768 00000100:00100000:3.0:1788839713.709811:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:3.0:1788839713.709823:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+48:12305:x1875734050192768:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:3.0:1788839713.709895:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839713.709923:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265736ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a77 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.709943:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839713.709948:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839713.710121:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.710135:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.710144:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839713.710186:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788839713.710206:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090bc5afb reply state 00000000451122e8 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.710218:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839713.710241:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839713.710244:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839713.710246:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839713.710462:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+50:12305:x1875734050192768:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 640us (2394us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788839713.710470:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000020:00080000:3.0:1788839713.710475:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788839713.872585:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839713.872720:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050192896 00000100:00100000:0.0:1788839713.872729:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050192896 00000100:00100000:0.0:1788839713.872834:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:0.0:1788839713.872845:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+50:12319:x1875734050192896:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1788839713.872870:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839713.872891:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265736c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a7e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.872958:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.872973:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.872983:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.872992:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873013:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873020:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873092:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873101:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873107:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839713.873148:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788839713.873152:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839713.873316:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873329:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873338:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873344:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873350:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873366:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839713.873371:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873378:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873391:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:0.0:1788839713.873394:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839713.873399:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873406:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a265736cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873419:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873424:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873430:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873435:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfcc00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839713.873437:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873443:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873462:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:0.0:1788839713.873464:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839713.873467:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873472:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a265736d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873501:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a265736c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 52 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873514:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 51 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839713.873521:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839713.873523:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839713.873526:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd400, rc 0) 00000100:00100000:0.0:1788839713.873604:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+51:12319:x1875734050192896:12345-192.168.203.52@tcp:101:stat.0 Request processed in 752us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839713.873611:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:2.0:1788839713.980742:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839713.980863:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050193152 00000100:00100000:1.0:1788839713.980874:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050193152 00000100:00100000:1.0:1788839713.980942:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:1.0:1788839713.980953:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+51:12329:x1875734050193152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839713.980991:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839713.981012:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a265736e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a85 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839713.981106:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788839713.981213:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a265736e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a85 expref: 53 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.981229:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:1.0:1788839713.981233:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839713.981238:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a265736e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a85 expref: 53 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839713.981251:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959400, rc 0) 00000100:00100000:1.0:1788839713.981325:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+52:12329:x1875734050193152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 372us (606us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788839713.981332:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00000040:00080000:2.0:1788839713.983927:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839713.983936:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839713.984031:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788839713.984039:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839713.984477:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839713.985915:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050193408 00000100:00100000:3.0:1788839713.985927:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050193408 00000100:00100000:3.0:1788839713.985994:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788839713.986005:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+52:12329:x1875734050193408:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839713.986433:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+53:12329:x1875734050193408:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 428us (1959us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788839713.986442:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1788839714.069957:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.070272:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050193664 00000100:00100000:3.0:1788839714.070282:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050193664 00000100:00080000:1.0:1788839714.070409:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839714.070453:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:3.0:1788839714.070465:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+53:12335:x1875734050193664:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839714.070492:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839714.070517:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265736f2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a8c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.070648:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.070664:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.070691:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.070907:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.070921:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 54 pid: 6489 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839714.070934:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060742144:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839714.071072:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742890e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839714.082373:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.082441:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050193792 00000100:00100000:0.0:1788839714.082451:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050193792 00000100:00100000:3.0:1788839714.082469:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060742144:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839714.082489:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 55 pid: 6489 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082492:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839714.082533:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1788839714.082542:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+55:2389:x1875734050193792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839714.082558:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839714.082565:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 55 pid: 6489 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082596:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 55 pid: 6489 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082621:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd400/0xad5b343a265736dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a7e expref: 55 pid: 6489 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082652:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839714.082657:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082666:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082674:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.082713:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839714.082765:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+54:2389:x1875734050193792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 223us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839714.082817:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00010000:00010000:1.0:1788839714.083894:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.083906:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839714.083929:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788839714.084095:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265736f2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 55 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.084177:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 54 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.084199:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839714.084202:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839714.084205:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:1.0:1788839714.084272:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+54:12335:x1875734050193664:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13809us (14325us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788839714.084280:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:2.0:1788839714.090936:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.091027:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050194048 00000100:00100000:0.0:1788839714.091037:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050194048 00000100:00100000:0.0:1788839714.091093:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:0.0:1788839714.091118:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+54:12335:x1875734050194048:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1788839714.091498:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.091517:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.091528:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839714.091574:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788839714.091908:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002598a67a reply state 0000000046c60c1b transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.091921:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.091929:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839714.091932:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788839714.091935:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839714.092068:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6483de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+57:12335:x1875734050194048:12345-192.168.203.52@tcp:36:bash.0 Request processed in 951us (1141us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788839714.092076:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 176 00000020:00080000:0.0:1788839714.092082:0:6489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788839714.105979:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.106178:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050194176 00000100:00100000:3.0:1788839714.106188:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050194176 00000100:00100000:3.0:1788839714.106251:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:3.0:1788839714.106262:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab747799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+57:12335:x1875734050194176:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839714.106287:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839714.106307:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657370e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a93 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.106408:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.106424:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 58 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.106450:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.106482:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 58 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.106496:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 58 pid: 6487 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839714.106509:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060742272:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839714.106863:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742890e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839714.114937:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839714.115125:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050194304 00000100:00100000:1.0:1788839714.115134:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050194304 00010000:00010000:1.0:1788839714.115175:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 59 pid: 6487 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839714.115218:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:1.0:1788839714.115229:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+59:2390:x1875734050194304:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839714.115243:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839714.115250:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 59 pid: 6487 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.115263:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 59 pid: 6487 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.115287:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839714.115293:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.115303:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.115330:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.115354:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839714.115415:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+59:2390:x1875734050194304:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 188us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839714.115422:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00010000:00010000:3.0:1788839714.115840:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265736f9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a8c expref: 58 pid: 6487 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839714.115860:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060742272:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839714.115880:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.115890:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.115896:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839714.115953:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788839714.115957:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839714.115979:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.117458:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657370e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a93 expref: 58 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.117485:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a93 expref: 57 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.117493:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839714.117496:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839714.117499:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839714.117573:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab747799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+57:12335:x1875734050194176:12345-192.168.203.52@tcp:101:bash.0 Request processed in 11311us (11602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839714.117600:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:2.0:1788839714.127557:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.128243:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050194560 00000100:00100000:0.0:1788839714.128254:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050194560 00000100:00100000:0.0:1788839714.128316:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788839714.128325:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+57:12335:x1875734050194560:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1788839714.128547:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+58:12335:x1875734050194560:12345-192.168.203.52@tcp:35:bash.0 Request processed in 222us (998us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788839714.128571:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1788839714.178124:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839714.178149:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060742400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839714.178216:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839714.178386:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060742400 00000100:00100000:1.0:1788839714.178394:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060742400 00000100:00100000:1.0:1788839714.178449:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788839714.178458:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060742400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839714.178495:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839714.178554:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060742400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839714.178561:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788839714.178728:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060742400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839714.231042:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.231145:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050194816 00000100:00100000:3.0:1788839714.231155:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050194816 00000100:00100000:3.0:1788839714.231215:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:3.0:1788839714.231224:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+58:12345:x1875734050194816:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839714.231250:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839714.231270:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657371c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74a9a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839714.231375:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788839714.231471:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657371c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a9a expref: 60 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.231486:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:3.0:1788839714.231503:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839714.231509:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657371c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a9a expref: 60 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.231526:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553800, rc 0) 00000100:00100000:3.0:1788839714.231740:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+59:12345:x1875734050194816:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 516us (709us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788839714.231748:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:2.0:1788839714.238937:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.239382:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050194944 00000100:00100000:0.0:1788839714.239392:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050194944 00000100:00100000:0.0:1788839714.239457:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:0.0:1788839714.239468:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+59:12345:x1875734050194944:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788839714.239552:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239570:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239603:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239614:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239622:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239628:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239717:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239729:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239750:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839714.239842:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239855:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239861:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239868:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239874:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfda00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839714.239878:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239885:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239896:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:0.0:1788839714.239899:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839714.239904:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239909:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfda00/0xad5b343a2657372a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239922:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239934:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239940:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239945:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839714.239949:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239955:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239963:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:0.0:1788839714.239966:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839714.239969:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239975:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573731 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239984:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239990:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239994:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.239998:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfde00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839714.240018:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.240024:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.240032:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839714.240034:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839714.240048:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.240053:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfde00/0xad5b343a26573738 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839714.240138:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+59:12345:x1875734050194944:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 671us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839714.240147:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:2.0:1788839714.243849:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.244522:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050195200 00000100:00100000:0.0:1788839714.244534:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050195200 00000100:00100000:0.0:1788839714.244618:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788839714.244629:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+59:12345:x1875734050195200:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839714.245557:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+60:12345:x1875734050195200:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 925us (1721us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788839714.245567:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1788839714.330221:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.330407:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050195456 00000100:00100000:3.0:1788839714.330418:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050195456 00000100:00100000:3.0:1788839714.330598:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:3.0:1788839714.330609:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+60:12348:x1875734050195456:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839714.330644:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839714.330668:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657373f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74aa1 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330799:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330814:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330824:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330834:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330840:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330857:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330980:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573754 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330991:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.330998:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573754 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839714.331007:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788839714.331087:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331094:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331101:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331107:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839714.331112:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331119:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331130:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839714.331133:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839714.331144:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331149:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573746 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331177:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331184:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331189:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331193:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839714.331196:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331202:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331210:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:3.0:1788839714.331212:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839714.331215:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331220:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657374d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331255:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657373f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aa1 expref: 63 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331279:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573754 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aa1 expref: 62 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.331286:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839714.331288:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839714.331290:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553c00, rc 0) 00000100:00100000:3.0:1788839714.331359:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+62:12348:x1875734050195456:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 752us (1149us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788839714.331366:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:2.0:1788839714.337262:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839714.337643:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.341226:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050195712 00000100:00100000:0.0:1788839714.341243:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050195712 00000100:00100000:0.0:1788839714.341316:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788839714.341327:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+62:2389:x1875734050195712:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839714.341342:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839714.341380:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573754 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aa1 expref: 62 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.341403:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839714.341409:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839714.341465:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+61:2389:x1875734050195712:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 140us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839714.341472:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1788839714.347021:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050195584 00000100:00100000:3.0:1788839714.347037:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050195584 00000100:00100000:3.0:1788839714.347104:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:3.0:1788839714.347115:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+61:12348:x1875734050195584:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1788839714.347203:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347222:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347235:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347272:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347278:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347302:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347308:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839714.347312:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347319:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347330:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839714.347332:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788839714.347336:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.347342:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573762 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839714.347418:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+61:12348:x1875734050195584:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 305us (10167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839714.347425:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:1.0:1788839714.354708:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.355020:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050195968 00000100:00100000:3.0:1788839714.355030:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050195968 00000100:00100000:3.0:1788839714.355089:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1788839714.355099:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+61:12348:x1875734050195968:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839714.355455:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+62:12348:x1875734050195968:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 351us (749us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788839714.355465:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000040:00080000:3.0:1788839714.495443:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788839714.557793:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839714.560991:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050196224 00000100:00100000:2.0:1788839714.561008:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050196224 00000100:00100000:2.0:1788839714.561089:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:2.0:1788839714.561101:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+62:12366:x1875734050196224:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1788839714.561128:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839714.561163:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573769 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74aa8 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839714.561274:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573770 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839714.561292:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573770 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839714.561304:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573770 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839714.561315:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788839714.561438:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573769 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aa8 expref: 65 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839714.561458:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573770 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aa8 expref: 64 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839714.561467:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:2.0:1788839714.561470:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788839714.561474:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:2.0:1788839714.561551:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12366:x1875734050196224:12345-192.168.203.52@tcp:101:cat.0 Request processed in 452us (3793us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788839714.561558:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:1.0:1788839714.617984:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.619077:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050196352 00000100:00100000:3.0:1788839714.619089:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050196352 00000100:00100000:3.0:1788839714.619167:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:3.0:1788839714.619178:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12367:x1875734050196352:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839714.619202:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839714.619224:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657377e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74aaf expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.619293:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573785 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.619308:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.619320:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839714.619374:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788839714.619377:0:12241:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839714.619394:0:12241:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573785 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.619420:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657377e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aaf expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.619441:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573785 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aaf expref: 65 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.619477:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839714.619480:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839714.619484:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:3.0:1788839714.619553:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12367:x1875734050196352:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 377us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839714.619560:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00010000:00010000:1.0:1788839714.623373:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839714.624373:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.624661:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050196736 00000100:00100000:0.0:1788839714.624671:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050196736 00000100:00100000:0.0:1788839714.624733:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788839714.624743:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12367:x1875734050196736:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839714.625254:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12367:x1875734050196736:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 510us (884us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788839714.625262:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1788839714.631744:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839714.631828:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050196864 00000100:00100000:3.0:1788839714.631839:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050196864 00000100:00100000:3.0:1788839714.631906:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788839714.631922:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12367:x1875734050196864:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1788839714.631937:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788839714.631985:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573715 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a93 expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.632009:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573770 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aa8 expref: 65 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.632021:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573612 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a4d expref: 64 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839714.632031:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839714.632036:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839714.632111:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+63:12367:x1875734050196864:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 196us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839714.632132:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1788839714.634310:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839714.634374:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050196992 00000100:00100000:0.0:1788839714.634383:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050196992 00000100:00100000:0.0:1788839714.634443:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:0.0:1788839714.634453:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+63:12367:x1875734050196992:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1788839714.634552:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.634569:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839714.634580:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839714.634709:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788839714.634808:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+63:12367:x1875734050196992:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 355us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839714.634816:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:0.0:1788839714.678395:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839714.678628:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050197120 00000100:00100000:1.0:1788839714.678639:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050197120 00000100:00100000:1.0:1788839714.678712:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:1.0:1788839714.678723:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+63:12369:x1875734050197120:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839714.678746:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839714.678836:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573793 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ab6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.678928:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.678942:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.678952:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.678972:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.678979:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.678985:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679063:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679073:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679081:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839714.679122:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788839714.679126:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839714.679146:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679166:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679175:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679181:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679186:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679192:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839714.679197:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679204:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679215:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839714.679218:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839714.679223:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679229:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657379a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679242:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679249:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679262:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679267:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839714.679270:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679276:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679284:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:1.0:1788839714.679287:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839714.679290:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679296:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679322:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573793 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 65 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679336:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 64 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839714.679343:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839714.679345:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839714.679347:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958c00, rc 0) 00000100:00100000:1.0:1788839714.679418:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12369:x1875734050197120:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 697us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839714.679433:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000040:00080000:0.0:1788839715.012277:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839715.012285:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839715.012320:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788839715.012326:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788839715.012448:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060742528:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839715.012863:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839715.018150:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060742528:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839715.035225:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.036965:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050197248 00000100:00100000:3.0:1788839715.036979:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050197248 00000100:00100000:3.0:1788839715.037052:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:3.0:1788839715.037063:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12380:x1875734050197248:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788839715.037097:0:6487:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788839715.043466:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab744356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12380:x1875734050197248:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 6393us (8240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839715.043481:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:3.0:1788839715.050640:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.053971:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050197376 00000100:00100000:2.0:1788839715.053998:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050197376 00000100:00100000:2.0:1788839715.054053:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:2.0:1788839715.054062:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12380:x1875734050197376:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788839715.054126:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054141:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054152:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054270:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054280:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054288:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054315:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054324:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054331:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839715.054379:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788839715.054383:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839715.054404:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054417:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054423:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054429:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054434:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839715.054439:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054579:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054603:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839715.054606:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839715.054611:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054618:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054631:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054637:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054642:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054654:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839715.054657:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054664:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054671:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8ab646801800) 00010000:00010000:2.0:1788839715.054674:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839715.054677:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054682:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737b6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054706:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054713:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054718:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054722:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839715.054725:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054731:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054906:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:2.0:1788839715.054908:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839715.054911:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.054916:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265737bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839715.055004:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12380:x1875734050197376:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 941us (4383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839715.055012:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:3.0:1788839715.067891:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.068064:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050197632 00000100:00100000:1.0:1788839715.068075:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050197632 00000100:00100000:1.0:1788839715.068131:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:1.0:1788839715.068141:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12380:x1875734050197632:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839715.068161:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839715.068182:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a265737c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74abd expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068293:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068308:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068320:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839715.068331:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788839715.068408:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068416:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068422:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068427:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839715.068431:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068452:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068466:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839715.068469:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839715.068474:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068479:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a265737cb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068520:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a265737c4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74abd expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068531:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:1.0:1788839715.068533:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839715.068537:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a265737c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74abd expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.068547:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959200, rc 0) 00000100:00100000:1.0:1788839715.068622:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12380:x1875734050197632:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 482us (740us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1788839715.068630:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:1.0:1788839715.075595:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.075637:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050197760 00000100:00100000:1.0:1788839715.075646:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050197760 00000100:00100000:1.0:1788839715.075712:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1788839715.075723:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12380:x1875734050197760:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839715.075799:0:6487:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839715.075909:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12380:x1875734050197760:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 188us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.075917:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1788839715.084859:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.085046:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050198016 00000100:00100000:2.0:1788839715.085056:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050198016 00000100:00100000:2.0:1788839715.085114:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:2.0:1788839715.085123:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12380:x1875734050198016:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839715.085143:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839715.085146:0:7438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788839715.085173:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573785 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aaf expref: 65 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.085205:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:2.0:1788839715.085211:0:7438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839715.085225:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737d9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ac4 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839715.085668:0:7438:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788839715.085849:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.085878:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.085888:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.085943:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737d9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ac4 expref: 67 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.085959:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ac4 expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.085967:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab646801800) 00010000:00010000:2.0:1788839715.085969:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839715.085972:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839715.086131:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12380:x1875734050198016:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1008us (1281us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788839715.086139:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1788839715.094451:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.094538:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050198272 00000100:00100000:2.0:1788839715.094548:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050198272 00000100:00100000:2.0:1788839715.094615:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:2.0:1788839715.094626:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12380:x1875734050198272:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839715.094686:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839715.094714:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a265737e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ac4 expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094732:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab646801800) 00010000:00010000:2.0:1788839715.094757:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839715.094831:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094845:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094854:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094868:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094874:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094880:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094924:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094931:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094936:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094941:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839715.094946:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094953:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094969:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:2.0:1788839715.094971:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839715.094975:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094981:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843c00/0xad5b343a265737ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094991:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.094996:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.095002:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.095007:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839715.095010:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.095015:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.095022:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x86ec3f6b (ffff8ab646801400) 00010000:00010000:2.0:1788839715.095024:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839715.095027:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.095032:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265737f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x86ec3f6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839715.095117:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12380:x1875734050198272:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 492us (676us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839715.095124:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1788839715.102092:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.106454:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050198400 00000100:00100000:1.0:1788839715.106470:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050198400 00000100:00100000:1.0:1788839715.106529:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:1.0:1788839715.106540:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12380:x1875734050198400:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839715.106560:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839715.106594:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a265737fc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74acb expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.106633:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.106646:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.106657:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.106804:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a265737fc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.106821:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 66 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.106841:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:1.0:1788839715.106844:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839715.106848:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958a00, rc 0) 00000100:00100000:1.0:1788839715.106911:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12380:x1875734050198400:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 374us (4829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.106919:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:0.0:1788839715.121889:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.122312:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050198656 00000100:00100000:3.0:1788839715.122323:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050198656 00000100:00100000:3.0:1788839715.122384:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:3.0:1788839715.122395:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12380:x1875734050198656:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788839715.122481:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.122498:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.122511:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839715.122692:0:7438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788839715.122703:0:7438:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370066932083ns, next at 371066929503ns, rc = 0 00000004:00010000:3.0:1788839715.122754:0:7438:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008fa5f8c reply state 0000000010998d6b transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.122793:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.122802:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:3.0:1788839715.122805:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788839715.122808:0:7438:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839715.122897:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+68:12380:x1875734050198656:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 503us (1018us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788839715.122906:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:1.0:1788839715.133941:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.134032:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050198784 00000100:00100000:3.0:1788839715.134041:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050198784 00000100:00100000:3.0:1788839715.134103:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:3.0:1788839715.134114:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+68:12380:x1875734050198784:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839715.134139:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839715.134171:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ad2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.134232:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 69 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.134247:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 69 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.134268:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:3.0:1788839715.134271:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839715.134276:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:3.0:1788839715.134491:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+69:12380:x1875734050198784:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 378us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839715.134512:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:0.0:1788839715.145961:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.146050:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050198912 00000100:00100000:3.0:1788839715.146059:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050198912 00000100:00100000:3.0:1788839715.146133:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788839715.146144:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+6:2390:x1875734050198912:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788839715.146369:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777f22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050198912:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 226us (417us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788839715.146376:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00080000:1.0:1788839715.148937:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839715.152426:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.152545:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050199168 00000100:00100000:2.0:1788839715.152555:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050199168 00000100:00100000:2.0:1788839715.152637:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1788839715.152649:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+69:12380:x1875734050199168:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788839715.156092:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+70:12380:x1875734050199168:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 3436us (3664us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788839715.156106:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788839715.164994:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.165407:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050199424 00000100:00100000:1.0:1788839715.165417:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050199424 00000100:00100000:1.0:1788839715.165484:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1788839715.165495:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+70:12380:x1875734050199424:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839715.165620:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+70:12380:x1875734050199424:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 126us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.165629:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:2.0:1788839715.176125:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839715.176620:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050199552 00000100:00100000:0.0:1788839715.176632:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050199552 00000100:00100000:0.0:1788839715.176696:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1788839715.176705:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+70:12380:x1875734050199552:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839715.176725:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839715.176744:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573818 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ad9 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.176852:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a2657381f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.176866:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a2657381f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.176878:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a2657381f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839715.176920:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839715.176939:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a2657381f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.176964:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573818 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad9 expref: 72 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.176979:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a2657381f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad9 expref: 71 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.176988:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:0.0:1788839715.176991:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788839715.176994:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc800, rc 0) 00000100:00100000:0.0:1788839715.177051:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+71:12380:x1875734050199552:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 346us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839715.177058:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1788839715.183738:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.183839:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050199680 00000100:00100000:1.0:1788839715.183849:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050199680 00000100:00100000:1.0:1788839715.183905:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1788839715.183916:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050199680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839715.183934:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839715.183955:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ae0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839715.183982:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8722, blocks: 0x0 00010000:00010000:1.0:1788839715.184000:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:1.0:1788839715.184011:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839715.184020:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.184039:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.184051:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959200, rc 0) 00000100:00100000:1.0:1788839715.184110:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050199680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 197us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.184117:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788839715.197230:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.197644:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050199936 00000100:00100000:3.0:1788839715.197653:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050199936 00000100:00100000:0.0:1788839715.197814:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:0.0:1788839715.197834:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+71:12380:x1875734050199936:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788839715.197938:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+71:12380:x1875734050199936:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 106us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839715.197947:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1788839715.200679:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839715.200938:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200064 00000100:00100000:0.0:1788839715.200947:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200064 00000100:00100000:0.0:1788839715.201025:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788839715.201034:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:12380:x1875734050200064:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839715.201052:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839715.201071:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ae7 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.201102:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 9 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.201111:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839715.201115:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839715.201120:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.201153:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 9 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.201168:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 9 pid: 8539 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839715.201200:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875734060742656:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839715.201328:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478c8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839715.204469:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.204540:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200192 00000100:00100000:1.0:1788839715.204549:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200192 00010000:00010000:1.0:1788839715.204612:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 10 pid: 8539 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839715.204654:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:1.0:1788839715.204664:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050200192:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839715.204679:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839715.204698:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 10 pid: 8539 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.204723:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 10 pid: 8539 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.204748:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839715.204765:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839715.204801:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.204811:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.204850:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 10 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839715.204863:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1875734060742784:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788839715.204943:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0600 going to sleep for 11 seconds 00010000:00010000:0.0:1788839715.207264:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fa6dbac/0xad5b343a26573826 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae0 expref: 10 pid: 8539 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839715.207291:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875734060742656:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839715.207456:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 9 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.207472:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfca00, rc 0) 00000100:00100000:0.0:1788839715.207662:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+9:12380:x1875734050200064:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 6628us (6990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839715.207670:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1788839715.209743:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1875734060742784:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788839715.209766:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839715.209830:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050200192:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 5167us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.209840:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1788839715.213743:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.214029:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200320 00000100:00100000:1.0:1788839715.214039:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200320 00002000:00100000:1.0:1788839715.214090:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ab64783d880 x1875734050200320/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:106/0 lens 504/0 e 0 to 0 dl 1788839726 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839715.214102:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab64783d880 with x1875734050200320 ext(0->8) 00002000:00010000:1.0:1788839715.214107:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab64783d880 00000100:00100000:1.0:1788839715.214139:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788839715.214149:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2391:x1875734050200320:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788839715.215322:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2391:x1875734050200320:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 1166us (1583us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788839715.215333:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00002000:00100000:1.0:1788839715.215342:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8ab64783d880 x1875734050200320/t4294967315(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:106/0 lens 504/448 e 0 to 0 dl 1788839726 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839715.215352:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab64783d880 with x1875734050200320 ext(0->8) 00002000:00010000:1.0:1788839715.215356:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab64783d880 00000100:00100000:3.0:1788839715.220758:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.220914:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200448 00000100:00100000:2.0:1788839715.220923:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200448 00000100:00100000:2.0:1788839715.220979:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:2.0:1788839715.220989:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+71:12380:x1875734050200448:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788839715.223100:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788839715.223117:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00010000:00010000:0.0:1788839715.223215:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223227:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223234:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223240:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223245:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223267:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223283:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab747cc7900) 00010000:00010000:0.0:1788839715.223286:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839715.223291:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223298:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a26573555 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223319:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223325:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223331:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223336:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223339:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223345:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223353:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:0.0:1788839715.223355:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839715.223358:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223370:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a2657355c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223387:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223393:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223398:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223402:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223405:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223411:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223418:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab747cc7400) 00010000:00010000:0.0:1788839715.223421:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839715.223423:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223428:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7c00/0xad5b343a2657359b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223441:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223447:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223459:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223464:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223467:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223472:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223481:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839715.223484:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839715.223487:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223493:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657369e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223505:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223510:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223516:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223521:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223523:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223538:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223546:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839715.223549:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839715.223552:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223557:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265736c1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223580:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223595:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223601:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223606:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223609:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223615:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223623:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:0.0:1788839715.223626:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839715.223629:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223646:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573707 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223658:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223665:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223672:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223677:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839715.223681:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223686:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223694:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:0.0:1788839715.223697:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788839715.223708:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.223714:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657380a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839715.227008:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060742912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788839715.227087:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839715.227152:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060742912 00000100:00100000:2.0:1788839715.227159:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060742912 00000100:00100000:2.0:1788839715.227215:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839715.227223:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060742912:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788839715.227349:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788839715.227353:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788839714 00002000:00010000:2.0:1788839715.227356:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788839715.227358:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788839714 -> 1788839714 00002000:00010000:2.0:1788839715.227360:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788839715.227411:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060742912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 189us (324us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788839715.227419:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788839715.227441:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788839715.227471:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab777e3b480/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788839715.227477:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060742912:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788839715.228100:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788839715.229722:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839715.229741:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060743040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788839715.229821:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839715.230050:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060743040 00000100:00100000:2.0:1788839715.230057:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060743040 00000100:00100000:2.0:1788839715.230111:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788839715.230120:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060743040:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788839715.230146:0:8538:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788839715.230173:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f871f, atime: 0x6a9f8720, ctime: 0x6a9f871f, blocks: 0x8 00010000:00010000:2.0:1788839715.230181:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230197:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1788839715.230201:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839715.230208:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230223:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230232:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230240:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230263:0:8538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788839715.230396:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060743040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 278us (575us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788839715.230403:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1788839715.230426:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839715.230433:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230441:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839715.230445:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230454:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230470:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230476:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.230492:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839715.230493:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839715.230495:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839715.230502:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:3.0:1788839715.231391:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab777f96840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788839715.231398:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab777bbf500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab777f96cc0 00000020:00080000:3.0:1788839715.231402:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab777bbf300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6480aec00 00000004:00080000:0.0:1788839715.233810:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab647bb4e00/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788839715.233823:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060743040:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788839715.233856:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1788839715.233924:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788839715.234051:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+19:12380:x1875734050200448:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 13061us (13302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839715.234062:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:2.0:1788839715.237673:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839715.237802:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200576 00000100:00100000:0.0:1788839715.237811:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200576 00000100:00100000:0.0:1788839715.237867:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788839715.237878:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050200576:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788839715.239394:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1788839715.239408:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788839715.239548:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050200576:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 1668us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839715.239559:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1788839715.244315:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.245315:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200832 00000100:00100000:1.0:1788839715.245327:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200832 00000100:00100000:1.0:1788839715.246404:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:1.0:1788839715.246419:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:12380:x1875734050200832:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839715.246484:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839715.246521:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc800/0xad5b343a2657381f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad9 expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.246537:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:1.0:1788839715.246542:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839715.246580:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.246603:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.246613:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839715.246747:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5ecf4c5 reply state 00000000d44953c9 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.246766:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.246793:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:1.0:1788839715.246796:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839715.246799:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839715.246904:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+20:12380:x1875734050200832:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 489us (2720us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788839715.246913:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:3.0:1788839715.256428:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.257864:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050200960 00000100:00100000:2.0:1788839715.257878:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050200960 00000100:00100000:2.0:1788839715.257941:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788839715.257950:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab64783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050200960:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788839715.258384:0:8539:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788839715.258388:0:8539:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788839714 -> 1788839713 00002000:00010000:2.0:1788839715.258391:0:8539:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788839712 00002000:00010000:2.0:1788839715.258393:0:8539:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788839714 -> 1788839713 00002000:00010000:2.0:1788839715.258395:0:8539:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788839715.258688:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab64783ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050200960:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 736us (2268us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788839715.258696:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788839715.263155:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.263313:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050201216 00000100:00100000:3.0:1788839715.263322:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050201216 00000100:00100000:3.0:1788839715.263380:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1788839715.263390:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+20:12380:x1875734050201216:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788839715.263484:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.263502:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.263512:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.263544:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.263558:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 20 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.264099:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060743168:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839715.265217:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839715.275163:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875734060743168:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839715.275204:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839715.280699:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.282271:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050201344 00000100:00100000:3.0:1788839715.282282:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050201344 00010000:00010000:3.0:1788839715.282325:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 21 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.282365:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1788839715.282375:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+21:2390:x1875734050201344:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839715.282389:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839715.282395:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 21 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.282421:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 21 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.282452:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a26573803 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74acb expref: 21 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.282466:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:3.0:1788839715.282472:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.282481:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.282489:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.282515:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839715.282563:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d09850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+20:2390:x1875734050201344:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 189us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839715.282589:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00010000:00010000:3.0:1788839715.284002:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284016:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284056:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284080:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284087:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284093:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.284097:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284105:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284118:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:3.0:1788839715.284121:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788839715.284125:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.284131:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a26573842 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.284210:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648288700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:12380:x1875734050201216:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 20819us (21060us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788839715.284220:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1788839715.287268:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.287423:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050201472 00000100:00100000:3.0:1788839715.287432:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050201472 00000100:00100000:3.0:1788839715.288470:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1788839715.288484:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050201472:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788839715.288526:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.288558:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.288567:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839715.288571:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839715.288576:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.288625:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.288639:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 8 pid: 8403 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.288653:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875734060743296:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839715.288742:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abf0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839715.300961:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.301580:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050201600 00000100:00100000:1.0:1788839715.301606:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050201600 00010000:00010000:1.0:1788839715.301654:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 9 pid: 8403 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839715.301712:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1788839715.301724:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050201600:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839715.301740:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839715.301761:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 9 pid: 8403 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.301801:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 9 pid: 8403 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.301846:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839715.301851:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839715.301858:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.301868:0:10307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.301889:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839715.301943:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050201600:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 221us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.301951:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00010000:00010000:3.0:1788839715.302538:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6cf806b/0xad5b343a2657382d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ae7 expref: 8 pid: 8403 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.302556:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875734060743296:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839715.302577:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302599:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302616:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302640:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302648:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302655:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302662:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839715.302666:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302674:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302687:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.302694:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ab582bf/0xad5b343a26573849 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.303230:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050201472:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 14748us (15983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839715.303238:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788839715.324310:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.324456:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050201856 00000100:00100000:1.0:1788839715.324466:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050201856 00000100:00100000:1.0:1788839715.324525:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1788839715.324546:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+19:12380:x1875734050201856:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788839715.324638:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.324655:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.324664:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.324709:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.324738:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 19 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839715.324753:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060743424:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839715.324860:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0900 going to sleep for 11 seconds 00000100:00100000:1.0:1788839715.328355:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.328390:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050201984 00000100:00100000:1.0:1788839715.328399:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050201984 00010000:00010000:1.0:1788839715.328440:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 20 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839715.328477:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1788839715.328486:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+20:2389:x1875734050201984:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839715.328500:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839715.328507:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 20 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.328520:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 20 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.328553:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:1.0:1788839715.328559:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.328573:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.328615:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.328636:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839715.328690:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+20:2389:x1875734050201984:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 204us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.328697:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00010000:00010000:3.0:1788839715.328904:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573697 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a70 expref: 19 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.328922:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060743424:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839715.328942:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.328950:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.328955:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.329130:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.329142:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.329149:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.329177:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.329203:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 19 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.329217:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060743552:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839715.329284:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647abfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839715.334109:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839715.334265:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050202112 00000100:00100000:0.0:1788839715.334276:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050202112 00010000:00010000:0.0:1788839715.334317:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 20 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839715.334357:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:0.0:1788839715.334367:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+20:2390:x1875734050202112:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839715.334380:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839715.334387:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 20 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.334412:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 20 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.334434:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:0.0:1788839715.334440:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.334449:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.334457:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.334475:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839715.334526:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+20:2390:x1875734050202112:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 161us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839715.334535:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00010000:00010000:3.0:1788839715.335139:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573811 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ad2 expref: 19 pid: 6487 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.335159:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060743552:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839715.335179:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.335188:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.335194:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839715.335301:0:7438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788839715.335401:0:7438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788839715.335429:0:7438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788839715.335506:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7438:1875734060743680:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788839715.335556:0:7438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839715.335607:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d73cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839715.337725:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060743680 00000100:00100000:0.0:1788839715.337739:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060743680 00000100:00100000:0.0:1788839715.337824:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788839715.337835:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7438:x1875734060743680:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788839715.337971:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74779a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7438:x1875734060743680:12345-0@lo:1000:mdt00_003.0 Request processed in 138us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839715.337977:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788839715.339387:0:7438:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788839715.339400:0:7438:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab777e3b480, transno 4294967316 00000100:00100000:3.0:1788839715.341645:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7438:1875734060743680:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788839715.341819:0:7438:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788839715.341895:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7438:1875734060743808:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788839715.341955:0:7438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839715.341978:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d73b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839715.342968:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060743808 00000100:00100000:0.0:1788839715.342979:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060743808 00000100:00100000:0.0:1788839715.343031:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788839715.343040:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7438:x1875734060743808:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788839715.343220:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7438:x1875734060743808:12345-0@lo:1000:mdt00_003.0 Request processed in 180us (1263us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788839715.343227:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788839715.346329:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab64783e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7438:1875734060743808:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788839715.346393:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346404:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346413:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346419:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.346423:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346431:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346446:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:3.0:1788839715.346449:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839715.346454:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346460:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573857 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346485:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346500:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346506:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346511:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.346514:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346520:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346528:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839715.346530:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839715.346533:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.346552:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a2657378c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.347474:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.347495:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.347505:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.347804:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.347828:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 22 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.347844:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060743936:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839715.347940:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839715.356632:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.356664:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050202240 00000100:00100000:3.0:1788839715.356671:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050202240 00010000:00010000:3.0:1788839715.356718:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 23 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.356752:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1788839715.356762:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+23:2389:x1875734050202240:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839715.356794:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839715.356802:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 23 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.356815:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 23 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.356839:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839715.356844:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.356853:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.356874:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.356893:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839715.356943:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+23:2389:x1875734050202240:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 182us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839715.356951:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00010000:00010000:3.0:1788839715.357000:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a265737a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ab6 expref: 22 pid: 6488 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.357014:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060743936:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839715.357033:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357042:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357047:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357058:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357064:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357070:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357076:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.357088:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357096:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357105:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839715.357107:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839715.357111:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357116:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657385e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357129:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357135:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357141:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357145:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.357147:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357152:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357159:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab646801d00) 00010000:00010000:3.0:1788839715.357161:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839715.357169:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.357175:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573850 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.357328:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12380:x1875734050201856:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 32794us (33029us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788839715.357336:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000020:00080000:3.0:1788839715.357340:0:7438:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788839715.361003:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839715.361012:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788839715.361824:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839715.361858:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050202496 00000100:00100000:0.0:1788839715.361867:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050202496 00000100:00100000:0.0:1788839715.361922:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788839715.361933:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12380:x1875734050202496:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788839715.362334:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788839715.362368:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788839715.362400:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362417:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362428:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362437:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362444:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362450:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362467:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788839715.362542:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+23:12380:x1875734050202496:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 611us (724us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788839715.362559:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000020:00080000:0.0:1788839715.362565:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788839715.362641:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839715.362647:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362654:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839715.362658:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362667:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362679:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:0.0:1788839715.362682:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788839715.362687:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839715.362693:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573865 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839715.363046:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788839715.363058:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788839715.363324:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839715.363327:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839715.363330:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839715.650231:0:14625:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839715.650240:0:14625:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839715.650261:0:14625:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788839715.650267:0:14625:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788839715.656640:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839715.817859:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.818145:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050202752 00000100:00100000:1.0:1788839715.818155:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050202752 00000100:00100000:1.0:1788839715.818226:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:1.0:1788839715.818236:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+23:12390:x1875734050202752:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839715.818258:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839715.818277:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657386c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74aee expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.818386:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26573873 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.818401:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26573873 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.818446:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26573873 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839715.818458:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788839715.818551:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a2657386c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aee expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.818591:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26573873 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aee expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.818600:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839715.818604:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788839715.818607:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959e00, rc 0) 00000100:00100000:1.0:1788839715.818658:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12390:x1875734050202752:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 424us (809us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788839715.818665:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:0.0:1788839715.825001:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.825083:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050202880 00000100:00100000:1.0:1788839715.825093:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050202880 00000100:00100000:1.0:1788839715.825163:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:1.0:1788839715.825174:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12390:x1875734050202880:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1788839715.825251:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825272:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825284:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825298:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825305:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825323:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825419:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825428:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825435:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839715.825479:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825493:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825500:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825506:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825512:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839715.825517:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825524:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825536:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839715.825546:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839715.825551:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825558:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573881 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825571:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825577:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825594:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825599:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839715.825602:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825608:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825616:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839715.825619:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839715.825622:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825628:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573888 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825642:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825654:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825661:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825666:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839715.825669:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825675:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825682:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab7750ced00) 00010000:00010000:1.0:1788839715.825685:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839715.825688:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839715.825719:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657388f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839715.825822:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12390:x1875734050202880:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 650us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839715.825831:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:1.0:1788839715.906681:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.906981:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050203136 00000100:00100000:3.0:1788839715.906993:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050203136 00000100:00100000:3.0:1788839715.907547:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:3.0:1788839715.907559:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12393:x1875734050203136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839715.907589:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839715.907610:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573896 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74af5 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907676:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907691:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907703:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907725:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907732:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907738:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907888:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907896:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907902:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839715.907911:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788839715.907982:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907990:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.907996:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908002:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.908006:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908024:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908036:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839715.908038:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839715.908042:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908048:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a2657389d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908060:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908065:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908070:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908074:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839715.908077:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908081:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908088:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab647855f00) 00010000:00010000:3.0:1788839715.908090:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839715.908092:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908105:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738a4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908145:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a26573896 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 28 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908159:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 27 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.908166:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839715.908168:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839715.908171:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839715.908238:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12393:x1875734050203136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 681us (1569us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788839715.908245:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:3.0:1788839715.921468:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.922196:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050203264 00000100:00100000:2.0:1788839715.922211:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050203264 00000100:00100000:2.0:1788839715.922276:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1788839715.922286:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12393:x1875734050203264:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788839715.922350:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.922381:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.922392:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.922428:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.922447:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.922453:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.923213:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839715.923218:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.923226:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.923240:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:2.0:1788839715.923243:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839715.923247:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.923254:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a265738b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839715.923341:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12393:x1875734050203264:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 1055us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839715.923349:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:0.0:1788839715.940017:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839715.940089:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050203520 00000100:00100000:3.0:1788839715.940102:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050203520 00000100:00100000:3.0:1788839715.940164:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1788839715.940174:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12393:x1875734050203520:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839715.940419:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+28:12393:x1875734050203520:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 245us (410us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788839715.940427:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788839715.989525:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839715.989961:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050203776 00000100:00100000:1.0:1788839715.989971:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050203776 00000100:00100000:3.0:1788839715.990130:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:3.0:1788839715.990145:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+28:11926:x1875734050203776:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839715.990186:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839715.990209:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738c0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74afc expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.990317:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.990332:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 29 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.990341:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.990375:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 29 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.990390:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 29 pid: 7438 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.990403:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060744064:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839715.990509:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839715.997946:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839715.998050:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050203904 00000100:00100000:2.0:1788839715.998060:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050203904 00010000:00010000:2.0:1788839715.998100:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 30 pid: 7438 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839715.998160:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:2.0:1788839715.998171:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+30:2390:x1875734050203904:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839715.998189:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839715.998197:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 30 pid: 7438 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.998209:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 30 pid: 7438 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.998234:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:2.0:1788839715.998240:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.998252:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.998259:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839715.998278:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839715.998338:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+30:2390:x1875734050203904:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 168us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839715.998345:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00010000:00010000:3.0:1788839715.998907:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74af5 expref: 29 pid: 7438 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839715.998926:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875734060744064:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839715.998945:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.998964:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.998971:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839715.998991:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788839715.999120:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 30 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.999137:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 29 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839715.999144:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839715.999147:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788839715.999150:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:3.0:1788839715.999241:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+29:11926:x1875734050203776:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9101us (9725us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788839715.999248:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:1.0:1788839716.005480:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.005590:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050204032 00000100:00100000:3.0:1788839716.005600:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050204032 00000100:00100000:3.0:1788839716.005686:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:3.0:1788839716.005702:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+29:11926:x1875734050204032:12345-192.168.203.52@tcp:101:bash.0 00000100:00080000:2.0:1788839716.005721:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839716.005726:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.005750:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a265738d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b03 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.005829:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265738dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.005842:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265738dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.005852:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265738dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.005950:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553800/0xad5b343a265738d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b03 expref: 31 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.005969:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265738dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b03 expref: 30 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.005977:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839716.005980:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788839716.005983:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552c00, rc 0) 00000100:00100000:3.0:1788839716.006036:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11926:x1875734050204032:12345-192.168.203.52@tcp:101:bash.0 Request processed in 341us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.006052:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:0.0:1788839716.008683:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.008763:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050204288 00000100:00100000:3.0:1788839716.008798:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050204288 00000100:00100000:3.0:1788839716.008856:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:3.0:1788839716.008867:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+30:11926:x1875734050204288:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1788839716.009087:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.009171:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.009182:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788839716.009226:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1788839716.009248:0:12241:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a686a8ed reply state 0000000004d4030d transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.009259:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.009266:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839716.009269:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839716.009271:0:12241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788839716.009306:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1788839716.009520:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+34:11926:x1875734050204288:12345-192.168.203.52@tcp:36:bash.0 Request processed in 654us (845us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788839716.009528:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000020:00080000:3.0:1788839716.009532:0:12241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788839716.015642:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.015752:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050204416 00000100:00100000:3.0:1788839716.015762:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050204416 00000100:00100000:3.0:1788839716.015843:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:3.0:1788839716.015852:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+34:11926:x1875734050204416:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839716.015875:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.015898:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b0a expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.015968:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b0a expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.015984:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b0a expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.016003:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839716.016006:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839716.016010:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839716.016111:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+35:11926:x1875734050204416:12345-192.168.203.52@tcp:101:bash.0 Request processed in 260us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.016119:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:2.0:1788839716.026828:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.027059:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050204544 00000100:00100000:3.0:1788839716.027069:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050204544 00000100:00100000:3.0:1788839716.027129:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:3.0:1788839716.027140:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:11926:x1875734050204544:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839716.027160:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.027181:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b11 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839716.027209:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f8721, atime: 0x6a9f8720, ctime: 0x6a9f8721, blocks: 0x8 00010000:00010000:3.0:1788839716.027230:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788839716.027234:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839716.027242:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.027279:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.027293:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553800, rc 0) 00000100:00100000:3.0:1788839716.027344:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:11926:x1875734050204544:12345-192.168.203.52@tcp:101:bash.0 Request processed in 206us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.027351:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1788839716.030959:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.031046:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050204672 00000100:00100000:3.0:1788839716.031057:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050204672 00002000:00010000:3.0:1788839716.031098:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788839716.031103:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab7819f9f80 with x1875734050204672 ext(0->18446744073709551615) 00002000:00010000:3.0:1788839716.031113:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab7819f9f80. 00000100:00100000:3.0:1788839716.031145:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1788839716.031156:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050204672:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:3.0:1788839716.031396:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788839716.031400:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788839713 -> 1788839715 00002000:00010000:3.0:1788839716.031402:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788839712 -> 1788839712 00002000:00010000:3.0:1788839716.031405:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788839713 -> 1788839715 00002000:00010000:3.0:1788839716.031407:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788839716.031470:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050204672:12345-192.168.203.52@tcp:10:bash.0 Request processed in 316us (520us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788839716.031479:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00002000:00010000:3.0:1788839716.031483:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788839716.031486:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab7819f9f80 with x1875734050204672 ext(0->18446744073709551615) 00002000:00010000:3.0:1788839716.031501:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab7819f9f80. 00000100:00100000:1.0:1788839716.148558:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.148620:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050204800 00000100:00100000:3.0:1788839716.148630:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050204800 00000100:00100000:3.0:1788839716.148692:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:3.0:1788839716.148701:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+35:12407:x1875734050204800:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1788839716.148792:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148810:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148825:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148841:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148848:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148854:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148925:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148933:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.148940:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839716.149005:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149016:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149022:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149030:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149036:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.149040:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149047:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149073:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839716.149076:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.149081:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149087:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a265738f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149101:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149339:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149353:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149359:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.149362:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149369:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149377:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab647855e00) 00010000:00010000:3.0:1788839716.149379:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.149383:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149389:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265738ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149405:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149411:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149417:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149422:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.149424:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149440:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149449:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839716.149451:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.149453:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.149459:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573906 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839716.149535:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+35:12407:x1875734050204800:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 833us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.149544:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:1.0:1788839716.213990:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.214262:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050205056 00000100:00100000:3.0:1788839716.214271:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050205056 00000100:00100000:3.0:1788839716.214336:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:3.0:1788839716.214347:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+35:12410:x1875734050205056:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839716.214370:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.214391:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a2657390d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b18 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214481:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214496:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214508:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214530:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214537:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214544:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214665:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573922 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214674:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214681:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573922 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839716.214689:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788839716.214808:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214816:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214822:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214827:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.214831:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214849:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214861:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839716.214864:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.214868:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214874:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573914 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214888:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214893:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214898:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214902:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.214905:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214910:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214916:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab647855e00) 00010000:00010000:3.0:1788839716.214918:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.214921:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214934:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a2657391b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214974:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a2657390d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b18 expref: 38 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214988:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573922 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b18 expref: 37 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.214996:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839716.214998:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788839716.215000:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078200, rc 0) 00000100:00100000:3.0:1788839716.215081:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12410:x1875734050205056:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 735us (1099us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788839716.215088:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1788839716.221941:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.222280:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050205184 00000100:00100000:0.0:1788839716.222290:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050205184 00000100:00100000:0.0:1788839716.222352:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:0.0:1788839716.222363:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12410:x1875734050205184:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788839716.222430:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.222448:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 37 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.222458:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.222491:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 37 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.222506:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 37 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.222520:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060744192:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839716.222638:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839716.227937:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875734060744192:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839716.227969:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839716.241520:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.241612:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050205440 00000100:00100000:3.0:1788839716.241622:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050205440 00000100:00100000:3.0:1788839716.241677:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788839716.241688:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+38:6162:x1875734050205440:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788839716.242098:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+39:6162:x1875734050205440:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 410us (586us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788839716.242118:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1788839716.251474:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839716.251590:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050205568 00000100:00100000:1.0:1788839716.251612:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050205568 00010000:00010000:1.0:1788839716.251655:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 39 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839716.251699:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:1.0:1788839716.251708:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+39:2390:x1875734050205568:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839716.251721:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839716.251727:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 39 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.251743:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 39 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.251764:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265738c7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74afc expref: 39 pid: 6488 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.251810:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:1.0:1788839716.251815:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.251825:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.251848:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.252220:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839716.252282:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+38:2390:x1875734050205568:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 572us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.252291:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00010000:00010000:0.0:1788839716.254177:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.254362:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254504:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254513:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254519:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254525:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfcc00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839716.254530:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254537:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254552:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:1.0:1788839716.254555:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839716.254634:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.254643:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfcc00/0xad5b343a26573930 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839716.254893:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12410:x1875734050205184:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 32527us (32957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.254904:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:2.0:1788839716.257957:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.258101:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050205824 00000100:00100000:0.0:1788839716.258180:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050205824 00000100:00100000:0.0:1788839716.258358:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788839716.258370:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+37:12410:x1875734050205824:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839716.258608:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+38:12410:x1875734050205824:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 240us (1160us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788839716.258616:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1788839716.415809:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.415894:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050206080 00000100:00100000:3.0:1788839716.415904:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050206080 00000100:00100000:3.0:1788839716.415969:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:3.0:1788839716.415979:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+38:12421:x1875734050206080:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788839716.416027:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.416049:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573937 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b1f expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416246:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416261:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416271:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416286:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416294:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416300:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416406:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657394c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416416:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416423:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657394c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839716.416437:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788839716.416522:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416530:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416536:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416542:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.416546:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416554:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416567:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839716.416569:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.416584:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416590:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079200/0xad5b343a2657393e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416605:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416611:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416617:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416621:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839716.416631:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416636:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416644:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab647855e00) 00010000:00010000:3.0:1788839716.416646:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839716.416649:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416654:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078000/0xad5b343a26573945 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416694:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078a00/0xad5b343a26573937 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b1f expref: 41 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416708:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657394c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b1f expref: 40 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.416715:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:3.0:1788839716.416717:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839716.416720:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:3.0:1788839716.417287:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6476b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+40:12421:x1875734050206080:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1306us (1514us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788839716.417296:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:2.0:1788839716.432743:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.435794:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050206336 00000100:00100000:3.0:1788839716.435820:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050206336 00000100:00100000:3.0:1788839716.435886:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788839716.435897:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+40:12421:x1875734050206336:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:3.0:1788839716.436386:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+41:12421:x1875734050206336:12345-192.168.203.52@tcp:35:cat.0 Request processed in 489us (3652us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788839716.436395:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1788839716.466402:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839716.466512:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050206592 00000100:00100000:1.0:1788839716.466522:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050206592 00000100:00100000:1.0:1788839716.466596:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:1.0:1788839716.466607:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+41:12422:x1875734050206592:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:1.0:1788839716.466666:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788839716.466694:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265738ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b0a expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466718:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657394c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b1f expref: 40 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466732:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078200/0xad5b343a26573922 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b18 expref: 39 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466746:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265738dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b03 expref: 38 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466755:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:1.0:1788839716.466760:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839716.466829:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466842:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466865:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466880:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466888:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466894:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466975:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466985:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.466992:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839716.467611:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1788839716.467623:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 371411851613ns, next at 372411848738ns, rc = 0 00010000:00010000:1.0:1788839716.467667:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467676:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467682:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467699:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467705:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467711:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467839:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839716.467858:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467864:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467871:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467876:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839716.467881:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467887:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467897:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:1.0:1788839716.467899:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788839716.467903:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467920:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a26573968 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467936:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467941:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467947:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467952:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839716.467955:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467961:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467969:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839716.467971:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839716.467974:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467981:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a2657395a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839716.467989:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b88965df reply state 00000000a9996e6f transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.467999:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.468012:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:1.0:1788839716.468014:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839716.468017:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839716.468094:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+39:12422:x1875734050206592:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1487us (1699us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788839716.468102:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00010000:00010000:0.0:1788839716.471841:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839716.471858:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.471868:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839716.471872:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.471881:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.471900:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:0.0:1788839716.471903:0:6475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788839716.471908:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.471914:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958c00/0xad5b343a2657396f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.471953:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839716.471954:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839716.471956:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839716.510148:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839716.510244:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050206848 00000100:00100000:1.0:1788839716.510253:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050206848 00000100:00100000:1.0:1788839716.510308:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1788839716.510327:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+39:12428:x1875734050206848:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839716.510354:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839716.510374:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573976 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b26 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.510468:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.510483:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.510493:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.510503:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.510509:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.510530:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788839716.510892:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788839716.511021:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511031:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511039:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511074:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511082:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511089:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511094:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839716.511099:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511106:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511118:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:1.0:1788839716.511121:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839716.511133:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511140:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a2657397d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839716.511153:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001be19f9b reply state 000000001ed7ca67 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511165:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511171:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:1.0:1788839716.511173:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839716.511175:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788839716.511202:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573976 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 42 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511214:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 41 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.511220:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839716.511223:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839716.511225:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958a00, rc 0) 00000100:00100000:1.0:1788839716.511277:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+42:12428:x1875734050206848:12345-192.168.203.52@tcp:101:bash.0 Request processed in 961us (1139us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788839716.511284:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:2.0:1788839716.515700:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.516086:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050206976 00000100:00100000:3.0:1788839716.516095:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050206976 00000100:00100000:3.0:1788839716.516241:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788839716.516252:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2392:x1875734050206976:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839716.516270:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788839716.516282:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788839716.516364:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b2d expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839716.516390:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839716.516409:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:3.0:1788839716.516413:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839716.516422:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 8 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.516440:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 8 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.516452:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553e00, rc 0) 00000100:00100000:3.0:1788839716.516508:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2392:x1875734050206976:12345-192.168.203.52@tcp:101:bash.0 Request processed in 258us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.516516:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:2.0:1788839716.519533:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.519815:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050207104 00000100:00100000:3.0:1788839716.519838:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050207104 00000100:00100000:3.0:1788839716.519899:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1788839716.519909:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:12428:x1875734050207104:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839716.519926:0:8404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.519944:0:8404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b34 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.519976:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 9 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.519984:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839716.519989:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839716.519993:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.520026:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 9 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.520040:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 9 pid: 8538 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839716.520053:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875734060744320:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839716.520261:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7467680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839716.531033:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.531217:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8404:1875734060744320:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839716.531257:0:8404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.531257:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050207232 00000100:00100000:0.0:1788839716.531266:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050207232 00010000:00010000:0.0:1788839716.531308:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 10 pid: 8538 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.531314:0:8404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:0.0:1788839716.531344:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1788839716.531351:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050207232:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839716.531365:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839716.531384:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 10 pid: 8538 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.531397:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 10 pid: 8538 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.531418:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f1a8797/0xad5b343a26573999 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b2d expref: 10 pid: 8538 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.531434:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839716.531438:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839716.531445:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.531468:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.531499:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.531513:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6474:1875734060744448:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788839716.538074:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:12428:x1875734050207104:12345-192.168.203.52@tcp:101:bash.0 Request processed in 18154us (18537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.538087:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1788839716.542889:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839716.547258:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.547363:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6474:1875734060744448:192.168.203.52@tcp:105: 00010000:00010000:3.0:1788839716.547390:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839716.547449:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d08850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050207232:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 16097us (16425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.547461:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:2.0:1788839716.547680:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050207488 00000100:00100000:2.0:1788839716.547688:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050207488 00000100:00100000:2.0:1788839716.547738:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788839716.547747:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+42:12428:x1875734050207488:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1788839716.549749:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12428:x1875734050207488:12345-192.168.203.52@tcp:35:bash.0 Request processed in 1992us (2491us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788839716.549764:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00010000:00010000:3.0:1788839716.673661:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839716.691580:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.691836:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050207616 00000100:00100000:3.0:1788839716.691846:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050207616 00000100:00100000:3.0:1788839716.691906:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:3.0:1788839716.691916:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+43:12444:x1875734050207616:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839716.691939:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.691957:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265739a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b3b expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.692016:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265739ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.692029:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265739ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.692039:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265739ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839716.692094:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788839716.692098:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839716.692241:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265739ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.692267:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265739a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b3b expref: 45 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.692299:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265739ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b3b expref: 44 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.692307:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839716.692311:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839716.692314:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553e00, rc 0) 00000100:00100000:3.0:1788839716.692584:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+44:12444:x1875734050207616:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 659us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.692592:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:0.0:1788839716.710625:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.711049:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050207872 00000100:00100000:3.0:1788839716.711059:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050207872 00000100:00100000:3.0:1788839716.711121:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:3.0:1788839716.711132:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+44:12444:x1875734050207872:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839716.711154:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.711176:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265739b5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b42 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.711281:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265739bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.711311:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265739bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.711322:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265739bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839716.711334:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788839716.711437:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a265739b5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b42 expref: 47 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.711456:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265739bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b42 expref: 46 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.711465:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:3.0:1788839716.711468:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839716.711472:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:3.0:1788839716.711520:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+46:12444:x1875734050207872:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 391us (905us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788839716.711528:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:1.0:1788839716.716913:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.717018:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050208000 00000100:00100000:0.0:1788839716.717028:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050208000 00000100:00100000:0.0:1788839716.717095:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788839716.717105:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+46:2391:x1875734050208000:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839716.717122:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839716.717146:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265739bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b42 expref: 46 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.717163:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:0.0:1788839716.717168:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839716.717314:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+45:2391:x1875734050208000:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 209us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.717322:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788839716.726330:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839716.726426:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050208256 00000100:00100000:1.0:1788839716.726436:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050208256 00000100:00100000:1.0:1788839716.727320:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:1.0:1788839716.727334:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+45:12444:x1875734050208256:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839716.727357:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839716.727377:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265739ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b49 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.727473:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a265739d1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.727497:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a265739d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.727508:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a265739d1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839716.727519:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788839716.727619:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958400/0xad5b343a265739ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b49 expref: 48 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.727636:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a265739d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b49 expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.727645:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:1.0:1788839716.727648:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788839716.727651:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959000, rc 0) 00000100:00100000:1.0:1788839716.730156:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+47:12444:x1875734050208256:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2816us (3826us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788839716.730168:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:0.0:1788839716.735295:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060744704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839716.735396:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839716.735662:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060744704 00000100:00100000:1.0:1788839716.735683:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060744704 00000100:00100000:1.0:1788839716.735736:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788839716.735744:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060744704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839716.735809:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839716.735858:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060744704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.735866:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788839716.735959:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060744704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839716.736122:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060744576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839716.736165:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839716.736189:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060744576 00000100:00100000:3.0:1788839716.736195:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060744576 00000100:00100000:2.0:1788839716.736215:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839716.736224:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060744832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839716.736240:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788839716.736251:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060744576:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839716.736252:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788839716.736269:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00080000:2.0:1788839716.736283:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839716.736316:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060744576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.736323:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788839716.736348:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060744832 00000100:00100000:3.0:1788839716.736354:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060744832 00000100:00100000:3.0:1788839716.736374:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788839716.736383:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6482d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060744832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839716.736396:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788839716.736407:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060745344:0@lo:400:kworker.0 00000100:00100000:3.0:1788839716.736427:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6482d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060744832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.736434:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788839716.736444:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839716.736467:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6482d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060744960:0@lo:400:kworker.0 00000100:00100000:3.0:1788839716.736496:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839716.736515:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060745472:0@lo:400:kworker.0 00000100:00100000:3.0:1788839716.736536:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839716.736547:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060745984:0@lo:400:kworker.0 00000100:00100000:3.0:1788839716.736593:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060745216:0@lo:400:kworker.0 00000100:00100000:3.0:1788839716.736615:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839716.736628:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060745728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.736642:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060744960 00000100:00100000:1.0:1788839716.736647:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060744960 00000100:00100000:0.0:1788839716.736723:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745472 00000100:00100000:0.0:1788839716.736727:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745472 00000100:00100000:0.0:1788839716.736751:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745216 00000100:00100000:0.0:1788839716.736753:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745216 00000100:00100000:0.0:1788839716.736764:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788839716.736786:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060745472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839716.736826:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060745472:12345-0@lo:400:kworker.0 Request processed in 56us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.736832:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788839716.736846:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788839716.736851:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7479f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060745216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839716.736878:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7479f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060745216:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.736883:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788839716.737379:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060745856:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.737410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839716.737432:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839716.737448:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060746240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839716.737476:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839716.737631:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745856 00000100:00100000:2.0:1788839716.737637:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745856 00000100:00100000:2.0:1788839716.737677:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839716.737684:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060745856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.737723:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060745856:12345-0@lo:400:kworker.0 Request processed in 40us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839716.737730:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788839716.737750:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839716.737760:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060745088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.737803:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839716.737923:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788839716.737932:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060744960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.737964:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3614:x1875734060744960:12345-0@lo:400:kworker.0 Request processed in 34us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.737971:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788839716.738074:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060746240 00000100:00100000:1.0:1788839716.738078:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060746240 00000100:00100000:1.0:1788839716.738097:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788839716.738103:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060746240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788839716.738115:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839716.738142:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7443d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060746240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.738148:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788839716.738189:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839716.738391:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6482d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060744960:0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.738405:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060745472:0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.738436:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745344 00000100:00100000:1.0:1788839716.738449:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745344 00000100:00100000:1.0:1788839716.738474:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745088 00000100:00100000:1.0:1788839716.738477:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745088 00000100:00100000:2.0:1788839716.739192:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6483df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060745600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.739604:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839716.739811:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060746112:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.739836:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839716.741178:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745984 00000100:00100000:1.0:1788839716.741189:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745984 00000100:00100000:1.0:1788839716.741258:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745600 00000100:00100000:1.0:1788839716.741261:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745600 00000100:00100000:1.0:1788839716.741278:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788839716.741286:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060745344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.741351:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060745344:12345-0@lo:400:kworker.0 Request processed in 65us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.741358:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788839716.741373:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788839716.741379:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060745088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.741405:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060745088:12345-0@lo:400:kworker.0 Request processed in 27us (3602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.741410:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788839716.741433:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788839716.741439:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060745984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.741469:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060745984:12345-0@lo:400:kworker.0 Request processed in 32us (3279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.741474:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788839716.741485:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788839716.741790:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060745600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.741824:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060745600:12345-0@lo:400:kworker.0 Request processed in 333us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.741831:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788839716.741893:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060745984:0@lo:400:kworker.0 00000100:00080000:1.0:1788839716.747858:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839716.747944:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060746240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839716.747996:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060745344:0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.748023:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060745856:0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.748660:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060746112 00000100:00100000:1.0:1788839716.748668:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060746112 00000100:00100000:1.0:1788839716.748729:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788839716.748739:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060746112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788839716.748933:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839716.750248:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839716.750315:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060744832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839716.750321:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060745728 00000100:00100000:0.0:1788839716.750329:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060745728 00000100:00100000:3.0:1788839716.750336:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060744576:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788839716.750358:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839716.750373:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060745216:0@lo:400:kworker.0 00000100:00100000:0.0:1788839716.750398:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788839716.750408:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060745728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839716.750435:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.750455:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050208384 00000100:00100000:3.0:1788839716.750458:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050208384 00000100:00100000:3.0:1788839716.750486:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788839716.750504:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2392:x1875734050208384:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1788839716.750539:0:8538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.751096:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060745728:12345-0@lo:400:kworker.0 Request processed in 689us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.751119:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:3.0:1788839716.751195:0:8538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.751208:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839716.751213:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839716.751219:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.751253:0:8538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 8 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.751268:0:8538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 8 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839716.751282:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1875734060746368:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839716.751343:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768300 going to sleep for 11 seconds 00010000:00080000:3.0:1788839716.751377:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6483dca80 x1875734060745728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839716.751389:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060745728:0@lo:400:kworker.0 00000100:00100000:1.0:1788839716.751887:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060746112:12345-0@lo:400:kworker.0 Request processed in 3147us (12047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.751896:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00080000:2.0:1788839716.752085:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777c36a00 x1875734060746112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839716.752096:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060746112:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.752119:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060745088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.752130:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6483df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060745600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839716.755410:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.755522:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8538:1875734060746368:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839716.755548:0:8538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839716.755672:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050208512 00000100:00100000:1.0:1788839716.755680:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050208512 00002000:00100000:1.0:1788839716.757346:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ab648266680 x1875734050208512/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:107/0 lens 504/0 e 0 to 0 dl 1788839727 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839716.757359:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab648266680 with x1875734050208512 ext(0->8) 00010000:00010000:1.0:1788839716.757368:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.757385:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 9 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839716.757393:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab648266680 00000100:00100000:1.0:1788839716.757432:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788839716.757455:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2390:x1875734050208512:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:1.0:1788839716.758956:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+11:2390:x1875734050208512:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 1234us (3287us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788839716.758969:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:1.0:1788839716.758980:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8ab648266680 x1875734050208512/t4294967309(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:107/0 lens 504/448 e 0 to 0 dl 1788839727 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839716.758990:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab648266680 with x1875734050208512 ext(0->8) 00010000:00010000:1.0:1788839716.758998:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 11 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.759013:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 11 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788839716.759020:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8ab648266680 00000100:00100000:0.0:1788839716.762281:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839716.762530:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050208640 00000100:00100000:1.0:1788839716.762540:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050208640 00010000:00010000:1.0:1788839716.762587:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 11 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839716.762626:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:1.0:1788839716.762637:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+11:2389:x1875734050208640:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839716.762654:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788839716.762670:0:10307:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788839716.762674:0:10307:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788839715 00002000:00010000:1.0:1788839716.762676:0:10307:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788839716 00002000:00010000:1.0:1788839716.762690:0:10307:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788839715 00002000:00010000:1.0:1788839716.762692:0:10307:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788839716.762699:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 11 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.762711:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 11 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.762733:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022b901f8/0xad5b343a265739a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b34 expref: 11 pid: 8404 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.762748:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839716.762752:0:10307:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839716.762758:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.762831:0:10307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839716.762863:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839716.762918:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050208640:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 282us (646us total) trans 0 rc 0/0 00010000:00010000:3.0:1788839716.762924:0:8538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839716.762926:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00010000:00010000:3.0:1788839716.762939:0:8538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.762960:0:8538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.762968:0:8538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.762977:0:8538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.762984:0:8538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839716.762988:0:8538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.762997:0:8538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.763008:0:8538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.763027:0:8538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e825a699/0xad5b343a265739df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839716.763075:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2392:x1875734050208384:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 12570us (12640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.763083:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1788839716.768435:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839716.768521:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050208896 00000100:00100000:2.0:1788839716.768534:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050208896 00000100:00100000:2.0:1788839716.768616:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1788839716.768640:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e57a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+47:12444:x1875734050208896:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:2.0:1788839716.768701:0:6491:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a265739d1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b49 expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839716.768906:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788839716.768935:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788839716.769215:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788839716.769251:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.769265:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 51 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.769275:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.769308:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 51 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.769322:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 51 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839716.769338:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875734060746496:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839716.769421:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839716.775090:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.775287:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050209024 00000100:00100000:0.0:1788839716.775296:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050209024 00010000:00010000:0.0:1788839716.775337:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 52 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.775386:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:0.0:1788839716.775397:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+52:2389:x1875734050209024:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839716.775412:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839716.775419:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 52 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.775433:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 52 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.775454:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:0.0:1788839716.775460:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.775470:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.775478:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.775498:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839716.775557:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+52:2389:x1875734050209024:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 162us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.775566:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00010000:00010000:3.0:1788839716.775811:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958a00/0xad5b343a2657398b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b26 expref: 51 pid: 6489 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839716.775832:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875734060746496:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839716.775854:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.775864:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.775869:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839716.776066:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788839716.776183:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788839716.776279:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060746624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788839716.776362:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839716.776395:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839716.776460:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060746624 00000100:00100000:1.0:1788839716.776467:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060746624 00000100:00100000:1.0:1788839716.776507:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788839716.776516:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6491:x1875734060746624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788839716.776624:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6491:x1875734060746624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839716.776631:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788839716.776832:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060746624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839716.776932:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788839716.776975:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060746752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788839716.777009:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839716.777030:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839716.777302:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060746752 00000100:00100000:0.0:1788839716.777307:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060746752 00000100:00100000:0.0:1788839716.777341:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788839716.777350:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6491:x1875734060746752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788839716.777451:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6491:x1875734060746752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (440us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788839716.777459:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788839716.777597:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875734060746752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788839716.777633:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788839716.777680:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.777689:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.777696:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.777702:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839716.777707:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.777715:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.777729:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:2.0:1788839716.777732:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788839716.777736:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839716.777741:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a265739e6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788839716.778069:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788839716.778127:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788839716.778138:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371722366827ns, next at 372722365142ns, rc = 0 00000001:00080000:2.0:1788839716.778151:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788839716.778173:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab7750ceb00) 00010000:00010000:2.0:1788839716.778176:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788839716.778182:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a265739d1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b49 expref: 55 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839716.778274:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e57a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+54:12444:x1875734050208896:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 9637us (9848us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788839716.778282:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000020:00080000:2.0:1788839716.778286:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788839716.784617:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.787334:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050209152 00000100:00100000:3.0:1788839716.787350:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050209152 00000100:00100000:3.0:1788839716.787433:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:3.0:1788839716.787448:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+54:12444:x1875734050209152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839716.787471:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839716.787494:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265739ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b50 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.787568:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265739ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b50 expref: 55 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.787605:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265739ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b50 expref: 55 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839716.787625:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:3.0:1788839716.787628:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839716.787631:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553c00, rc 0) 00000100:00100000:3.0:1788839716.787696:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+55:12444:x1875734050209152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 255us (3089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839716.787703:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:0.0:1788839716.793321:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839716.793496:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050209408 00000100:00100000:2.0:1788839716.793506:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050209408 00000100:00100000:2.0:1788839716.793564:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1788839716.793589:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+55:12444:x1875734050209408:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839716.793985:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+56:12444:x1875734050209408:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 410us (671us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788839716.793994:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1788839716.897156:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.897258:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050209536 00000100:00100000:0.0:1788839716.897268:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050209536 00000100:00100000:0.0:1788839716.897330:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:0.0:1788839716.897341:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+56:12454:x1875734050209536:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788839716.897415:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897434:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897445:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897456:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897463:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897484:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897563:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897583:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897600:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839716.897648:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897661:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897667:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897675:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897681:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839716.897685:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897692:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897703:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:0.0:1788839716.897712:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839716.897717:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897724:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a265739f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897738:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897743:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897750:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897755:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfce00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839716.897758:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897764:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897833:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:0.0:1788839716.897837:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839716.897840:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897846:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a265739fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897856:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897868:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897873:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897879:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839716.897882:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897888:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897895:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839716.897897:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839716.897900:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.897905:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.897964:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+56:12454:x1875734050209536:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 625us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.897971:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:1.0:1788839716.970185:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.970288:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050209792 00000100:00100000:0.0:1788839716.970298:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050209792 00000100:00100000:0.0:1788839716.970359:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:0.0:1788839716.970368:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+56:12457:x1875734050209792:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839716.970387:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839716.970420:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a09 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b57 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970485:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970498:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970509:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970519:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970525:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970531:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970651:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970659:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970666:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839716.970675:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788839716.970760:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970803:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970809:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970815:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfce00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839716.970820:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970827:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970841:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:0.0:1788839716.970844:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839716.970848:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970855:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970868:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970873:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970879:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970883:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839716.970892:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970898:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970907:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:0.0:1788839716.970909:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839716.970912:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970917:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970951:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a09 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b57 expref: 59 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970964:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b57 expref: 58 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.970971:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839716.970973:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839716.970975:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc200, rc 0) 00000100:00100000:0.0:1788839716.971035:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+58:12457:x1875734050209792:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 668us (862us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788839716.971043:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:1.0:1788839716.973664:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839716.973738:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050209920 00000100:00100000:0.0:1788839716.973748:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050209920 00000100:00100000:0.0:1788839716.973857:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:0.0:1788839716.973869:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+58:12457:x1875734050209920:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1788839716.973947:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.973965:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.973975:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974010:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974017:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974024:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974030:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839716.974034:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974041:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974052:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839716.974067:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788839716.974072:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839716.974079:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839716.974165:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+58:12457:x1875734050209920:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 298us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839716.974172:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:2.0:1788839716.976449:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839716.976538:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050210176 00000100:00100000:3.0:1788839716.976547:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050210176 00000100:00100000:3.0:1788839716.976624:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1788839716.976635:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+58:12457:x1875734050210176:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1788839716.976889:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+59:12457:x1875734050210176:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 255us (446us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788839716.976897:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1788839717.138998:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.139236:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050210432 00000100:00100000:0.0:1788839717.139246:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050210432 00000100:00100000:0.0:1788839717.139316:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:0.0:1788839717.139327:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+59:12468:x1875734050210432:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839717.139350:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839717.139353:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788839717.139382:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a265739ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b3b expref: 59 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.139404:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:0.0:1788839717.139409:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839717.139423:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a33 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b5e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.139528:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.139542:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.139552:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839717.139562:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788839717.139910:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a33 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b5e expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.139936:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b5e expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.139944:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.139946:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839717.139949:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd200, rc 0) 00000100:00100000:1.0:1788839717.140319:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+60:12468:x1875734050210432:12345-192.168.203.52@tcp:101:bash.0 Request processed in 991us (1330us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788839717.140328:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:3.0:1788839717.156622:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.156713:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.157429:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050210560 00000100:00100000:0.0:1788839717.157442:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050210560 00000100:00100000:0.0:1788839717.157512:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:0.0:1788839717.157523:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+60:12468:x1875734050210560:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839717.157547:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839717.157579:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a48 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b65 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.157615:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.157632:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.157643:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.157802:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 62 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.157821:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 61 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.157837:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.157839:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839717.157843:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfce00, rc 0) 00000100:00100000:0.0:1788839717.157903:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+61:12468:x1875734050210560:12345-192.168.203.52@tcp:101:bash.0 Request processed in 383us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.157911:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:1.0:1788839717.158110:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050210688 00000100:00100000:1.0:1788839717.158118:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050210688 00000100:00100000:1.0:1788839717.158169:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788839717.158177:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+61:2392:x1875734050210688:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839717.158189:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839717.158204:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd200/0xad5b343a26573a3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b5e expref: 61 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.158216:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.158220:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839717.158253:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+60:2392:x1875734050210688:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 77us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839717.158260:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788839717.162246:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.164862:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050210944 00000100:00100000:0.0:1788839717.164876:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050210944 00000100:00100000:0.0:1788839717.164963:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:0.0:1788839717.164974:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+60:12468:x1875734050210944:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1788839717.165041:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839717.165073:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b57 expref: 60 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.165092:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.165097:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839717.165290:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.165314:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.165324:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788839717.165369:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788839717.165392:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa8031b2 reply state 00000000dabc57d1 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.165422:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.165429:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.165432:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788839717.165434:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788839717.165544:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+62:12468:x1875734050210944:12345-192.168.203.52@tcp:36:bash.0 Request processed in 571us (3307us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788839717.165552:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000020:00080000:0.0:1788839717.165568:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788839717.171739:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839717.172169:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050211072 00000100:00100000:1.0:1788839717.172180:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050211072 00000100:00100000:1.0:1788839717.172247:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:1.0:1788839717.172258:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77508c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+62:12468:x1875734050211072:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839717.172283:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839717.172324:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573a5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b6c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.172429:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.172443:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.172454:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839717.172483:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788839717.172487:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839717.172505:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.172531:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573a5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 64 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.172548:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 63 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.172557:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.172560:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788839717.172563:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959600, rc 0) 00000100:00100000:1.0:1788839717.172641:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77508c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+63:12468:x1875734050211072:12345-192.168.203.52@tcp:101:bash.0 Request processed in 386us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839717.172648:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:2.0:1788839717.176261:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.176424:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050211328 00000100:00100000:3.0:1788839717.176434:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050211328 00000100:00100000:3.0:1788839717.176523:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1788839717.176535:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+63:12468:x1875734050211328:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1788839717.176974:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12468:x1875734050211328:12345-192.168.203.52@tcp:35:bash.0 Request processed in 440us (720us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788839717.176992:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1788839717.248087:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060746880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839717.248171:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839717.248631:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060746880 00000100:00100000:2.0:1788839717.248640:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060746880 00000100:00100000:2.0:1788839717.248755:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788839717.248801:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060746880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839717.248908:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788839717.249075:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060746880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 309us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.249083:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788839717.250130:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060746880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839717.285142:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.286077:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050211456 00000100:00100000:2.0:1788839717.286091:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050211456 00000100:00100000:2.0:1788839717.286170:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:2.0:1788839717.286182:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+64:12474:x1875734050211456:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839717.286211:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839717.286234:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573a6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b73 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.286311:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573a72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.286326:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.286337:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839717.286383:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788839717.286386:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839717.286404:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573a72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.286427:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573a6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b73 expref: 66 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.286657:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573a72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b73 expref: 65 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.286684:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:2.0:1788839717.286687:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839717.286691:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843600, rc 0) 00000100:00100000:2.0:1788839717.286818:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12474:x1875734050211456:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 590us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.286825:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:2.0:1788839717.299708:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.300100:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050211584 00000100:00100000:3.0:1788839717.300111:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050211584 00000100:00100000:3.0:1788839717.300179:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:3.0:1788839717.300189:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12474:x1875734050211584:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839717.300210:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839717.300231:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573a79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b7a expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300300:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300711:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300727:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300742:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300750:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300755:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300878:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300887:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300905:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839717.300947:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788839717.300951:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839717.300968:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300979:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300987:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.300993:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301000:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301006:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839717.301010:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301016:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301035:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839717.301038:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839717.301043:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301050:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573a80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301065:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301071:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301077:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301082:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839717.301084:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301090:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301098:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:3.0:1788839717.301100:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839717.301104:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301110:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573a87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301149:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573a79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 67 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301163:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.301171:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:3.0:1788839717.301173:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839717.301175:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:3.0:1788839717.302752:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12474:x1875734050211584:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2554us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.302764:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:3.0:1788839717.306970:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.307205:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050211840 00000100:00100000:0.0:1788839717.307217:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050211840 00000100:00100000:0.0:1788839717.307291:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:0.0:1788839717.307302:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12474:x1875734050211840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839717.307335:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839717.307356:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b81 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.307905:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.307923:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.307933:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 67 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.307940:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.307997:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 67 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.308012:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 67 pid: 7438 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.308026:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060747008:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839717.308137:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.308148:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 67 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.308158:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060747136:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839717.308184:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839717.308289:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.308957:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050211968 00000100:00100000:0.0:1788839717.308966:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050211968 00010000:00010000:0.0:1788839717.308995:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 68 pid: 7438 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.309029:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1788839717.309037:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+68:2390:x1875734050211968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839717.309048:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839717.309062:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 68 pid: 7438 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.309090:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 68 pid: 7438 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.309110:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.309116:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.309124:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.309131:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839717.309175:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+68:2390:x1875734050211968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 139us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.309189:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00010000:00010000:0.0:1788839717.312898:0:12241:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.52@tcp) returned -22 from blocking AST (req@00000000cf3cd679 x1875734060747008) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 67 pid: 7438 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.312929:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573a8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b7a expref: 67 pid: 7438 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.312952:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060747008:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839717.314950:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.315039:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050212096 00000100:00100000:2.0:1788839717.315048:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050212096 00010000:00010000:2.0:1788839717.315090:0:8419:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 67 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.315131:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1788839717.315141:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+67:2389:x1875734050212096:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839717.315157:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839717.315165:0:8419:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 67 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.315178:0:8419:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 67 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.315198:0:8419:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839717.315204:0:8419:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.315213:0:8419:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.315234:0:8419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.315267:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839717.315428:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+67:2389:x1875734050212096:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 287us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.315435:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00010000:00010000:0.0:1788839717.315854:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573a64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b6c expref: 66 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.315872:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060747136:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839717.315906:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.315911:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.315920:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.315926:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839717.315944:0:12241:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788839717.316068:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573a95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 67 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.316083:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 66 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.316091:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.316094:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839717.316097:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc400, rc 0) 00000100:00100000:0.0:1788839717.316133:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12474:x1875734050211840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 8833us (9173us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788839717.316140:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:1.0:1788839717.324882:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.324997:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050212352 00000100:00100000:0.0:1788839717.325007:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050212352 00000100:00100000:0.0:1788839717.325077:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788839717.325088:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12474:x1875734050212352:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:0.0:1788839717.325116:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839717.325157:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a265739ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b50 expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.325178:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:0.0:1788839717.325183:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839717.325233:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12474:x1875734050212352:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 148us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.325252:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1788839717.331873:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.331970:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050212480 00000100:00100000:0.0:1788839717.331979:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050212480 00000100:00100000:0.0:1788839717.332039:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:0.0:1788839717.332050:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12474:x1875734050212480:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1788839717.332154:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.332172:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.332185:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839717.332291:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788839717.332387:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12474:x1875734050212480:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 338us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.332394:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:1.0:1788839717.344334:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.344724:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050212608 00000100:00100000:3.0:1788839717.344735:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050212608 00000100:00100000:3.0:1788839717.344835:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:3.0:1788839717.344846:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+65:12474:x1875734050212608:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839717.344867:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839717.344889:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b88 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.344946:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.344956:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.344989:0:7438:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.345003:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.345017:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:3.0:1788839717.345020:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839717.345023:0:7438:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 66 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.345030:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552c00, rc 0) 00000100:00100000:3.0:1788839717.345085:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12474:x1875734050212608:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 241us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.345092:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 231 00000040:00080000:2.0:1788839717.438999:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839717.439009:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839717.439035:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788839717.439044:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839717.439177:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060747264:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839717.440238:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61840 going to sleep for 11 seconds 00000100:00100000:1.0:1788839717.450046:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.450129:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050212736 00000100:00100000:0.0:1788839717.450137:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050212736 00000100:00100000:0.0:1788839717.450197:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:0.0:1788839717.450206:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050212736:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788839717.450250:0:12241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788839717.450854:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050212736:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 644us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.450863:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:2.0:1788839717.454533:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060747264:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788839717.457149:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.457590:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050212864 00000100:00100000:2.0:1788839717.457607:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050212864 00000100:00100000:2.0:1788839717.457676:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:2.0:1788839717.457688:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12475:x1875734050212864:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788839717.457812:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457831:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457842:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457878:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457885:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457892:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457913:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457921:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.457927:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839717.457969:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788839717.457974:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839717.458005:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458016:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458022:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458029:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458045:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839717.458050:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458057:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458070:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839717.458073:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839717.458077:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458083:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843a00/0xad5b343a26573ab8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458098:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458104:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458109:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458114:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839717.458116:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458122:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458139:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8ab646801800) 00010000:00010000:2.0:1788839717.458141:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839717.458144:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458149:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573abf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458163:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458168:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458173:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458177:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839717.458180:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458185:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458191:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839717.458193:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839717.458195:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.458200:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573ac6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.458296:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12475:x1875734050212864:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 609us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.458304:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:1.0:1788839717.471554:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.471663:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050213120 00000100:00100000:2.0:1788839717.471673:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050213120 00000100:00100000:2.0:1788839717.471746:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:2.0:1788839717.471756:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+66:12475:x1875734050213120:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839717.471806:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839717.471831:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573acd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b8f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.471944:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.471959:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.471969:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839717.471979:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788839717.472053:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472061:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472067:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472091:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839717.472095:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472103:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472115:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839717.472118:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788839717.472122:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472128:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573ad4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472168:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573acd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b8f expref: 68 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472179:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839717.472181:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839717.472184:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573acd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b8f expref: 68 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.472193:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843e00, rc 0) 00000100:00100000:2.0:1788839717.472261:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050213120:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 507us (717us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788839717.472267:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:1.0:1788839717.478555:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.486963:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050213248 00000100:00100000:0.0:1788839717.486978:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050213248 00000100:00100000:0.0:1788839717.487065:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:0.0:1788839717.487077:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050213248:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788839717.487119:0:12241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788839717.487232:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050213248:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 157us (8688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.487240:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:1.0:1788839717.491250:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.491350:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050213504 00000100:00100000:3.0:1788839717.491361:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050213504 00000100:00100000:3.0:1788839717.491428:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:3.0:1788839717.491438:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050213504:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.491459:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839717.491463:0:7438:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788839717.491489:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843600/0xad5b343a26573a72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b73 expref: 67 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.491510:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839717.491516:0:7438:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839717.491543:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573ae2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b96 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788839717.492017:0:7438:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:3.0:1788839717.492155:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573ae9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.492168:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.492177:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.492231:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573ae2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b96 expref: 69 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.492246:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b96 expref: 68 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.492255:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab647855700) 00010000:00010000:3.0:1788839717.492257:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839717.492259:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839717.492320:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+68:12475:x1875734050213504:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 884us (1082us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788839717.492327:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:1.0:1788839717.505424:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.505605:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050213760 00000100:00100000:3.0:1788839717.505614:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050213760 00000100:00100000:3.0:1788839717.505677:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:3.0:1788839717.505687:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+68:12475:x1875734050213760:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.505811:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839717.505844:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573ae9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b96 expref: 68 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.505866:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab647855700) 00010000:00010000:3.0:1788839717.505878:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839717.505905:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.505921:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.505932:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.505948:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.505955:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.505962:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506008:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506015:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506021:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506035:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839717.506040:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506048:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506058:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839717.506060:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839717.506064:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506070:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573af7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506081:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506087:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506093:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506098:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839717.506101:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506107:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506126:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xd115c38b (ffff8ab647855900) 00010000:00010000:3.0:1788839717.506128:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839717.506131:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.506137:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573afe lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xd115c38b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839717.506213:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050213760:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 527us (799us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839717.506222:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:0.0:1788839717.514493:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.514612:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050213888 00000100:00100000:2.0:1788839717.514636:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050213888 00000100:00100000:2.0:1788839717.514702:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:2.0:1788839717.514712:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+67:12475:x1875734050213888:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839717.514733:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839717.514757:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74b9d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.514836:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.514850:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.514861:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.514964:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 69 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.514983:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 68 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.514993:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:2.0:1788839717.515006:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839717.515010:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842c00, rc 0) 00000100:00100000:2.0:1788839717.515116:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+68:12475:x1875734050213888:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 406us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.515124:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:1.0:1788839717.527057:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.527148:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214144 00000100:00100000:2.0:1788839717.527171:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214144 00000100:00100000:2.0:1788839717.527230:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:2.0:1788839717.527241:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+68:12475:x1875734050214144:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839717.527327:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.527345:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.527356:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839717.527517:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:2.0:1788839717.527529:0:6489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 372471757739ns, next at 373471754967ns, rc = 0 00000004:00010000:2.0:1788839717.527590:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063e6ae3d reply state 00000000afd61275 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.527603:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.527610:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:2.0:1788839717.527613:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788839717.527616:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839717.527717:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+70:12475:x1875734050214144:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 476us (667us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788839717.527987:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:1.0:1788839717.539208:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.539477:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214272 00000100:00100000:0.0:1788839717.539487:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214272 00000100:00100000:0.0:1788839717.539554:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:0.0:1788839717.539578:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+70:12475:x1875734050214272:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839717.539603:0:12241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839717.539623:0:12241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ba4 expref: -99 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.539678:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 71 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.539694:0:12241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 71 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.539736:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:0.0:1788839717.539739:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788839717.539743:0:12241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd800, rc 0) 00000100:00100000:0.0:1788839717.539832:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+71:12475:x1875734050214272:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 268us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.539841:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:0.0:1788839717.548435:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.548477:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.548507:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.548592:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214400 00000100:00100000:3.0:1788839717.548602:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214400 00000100:00100000:3.0:1788839717.548670:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1788839717.548681:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050214400:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788839717.548932:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050214400:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 253us (507us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788839717.548942:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1788839717.549486:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.549593:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.549614:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214784 00000100:00100000:3.0:1788839717.549620:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214784 00000100:00100000:3.0:1788839717.549651:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:3.0:1788839717.549658:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2390:x1875734050214784:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839717.549696:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2390:x1875734050214784:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.549719:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:3.0:1788839717.549945:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214656 00000100:00100000:3.0:1788839717.549950:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214656 00000100:00100000:3.0:1788839717.549979:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214912 00000100:00100000:3.0:1788839717.549981:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214912 00000100:00100000:2.0:1788839717.550306:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050214528 00000100:00100000:2.0:1788839717.550311:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050214528 00000100:00100000:2.0:1788839717.550350:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 393 00000100:00100000:2.0:1788839717.550358:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050214528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839717.550402:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050214528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.550409:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 393 00000100:00100000:2.0:1788839717.550444:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 336 00000100:00100000:2.0:1788839717.550452:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050214656:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839717.550488:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050214656:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.550494:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 336 00000100:00100000:2.0:1788839717.550517:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 337 00000100:00100000:2.0:1788839717.550525:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050214912:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839717.550550:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050214912:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.550574:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 337 00000100:00100000:1.0:1788839717.550696:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00080000:0.0:1788839717.550841:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839717.550846:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788839717.550849:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839717.550861:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050215040 00000100:00100000:0.0:1788839717.550865:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050215040 00000100:00080000:0.0:1788839717.550883:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839717.550910:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 338 00000100:00100000:0.0:1788839717.550918:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050215040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839717.550947:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050215040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.550955:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 338 00000100:00100000:1.0:1788839717.556722:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.561873:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050215296 00000100:00100000:2.0:1788839717.561890:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050215296 00000100:00100000:2.0:1788839717.562024:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1788839717.562036:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+71:12475:x1875734050215296:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839717.562273:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+72:12475:x1875734050215296:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 239us (5560us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788839717.562281:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1788839717.567597:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839717.567841:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050215552 00000100:00100000:1.0:1788839717.567851:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050215552 00000100:00100000:1.0:1788839717.567913:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:1.0:1788839717.567924:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+72:12475:x1875734050215552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839717.568047:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+72:12475:x1875734050215552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 125us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839717.568055:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:1.0:1788839717.571305:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.571419:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050215680 00000100:00100000:3.0:1788839717.571430:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050215680 00000100:00100000:3.0:1788839717.571538:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:3.0:1788839717.571549:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+72:12475:x1875734050215680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.571590:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839717.571617:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bab expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.571689:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573b28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.571715:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.571735:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839717.571954:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839717.571974:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573b28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.572113:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bab expref: 74 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.572132:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573b28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bab expref: 73 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.572155:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:3.0:1788839717.572158:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788839717.572161:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839717.572223:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+73:12475:x1875734050215680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 674us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.572230:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:2.0:1788839717.575122:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.575283:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050215808 00000100:00100000:3.0:1788839717.575292:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050215808 00000100:00100000:3.0:1788839717.575352:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1788839717.575362:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+10:2389:x1875734050215808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.575380:0:8538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839717.575400:0:8538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bb2 expref: -99 pid: 8538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839717.575426:0:8538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f8724, blocks: 0x0 00010000:00010000:3.0:1788839717.575446:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=372s v=(0 0) 00010000:00010000:3.0:1788839717.575451:0:8538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839717.575461:0:8538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 11 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.575480:0:8538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 11 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.575494:0:8538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:3.0:1788839717.575562:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+11:2389:x1875734050215808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 202us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.575581:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788839717.588603:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.588721:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216064 00000100:00100000:2.0:1788839717.588729:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216064 00000100:00100000:2.0:1788839717.588828:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:2.0:1788839717.588850:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+73:12475:x1875734050216064:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788839717.588959:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+73:12475:x1875734050216064:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 110us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.588967:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:1.0:1788839717.591736:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.592060:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216192 00000100:00100000:3.0:1788839717.592070:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216192 00000100:00100000:3.0:1788839717.592127:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:3.0:1788839717.592137:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+11:12475:x1875734050216192:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.592155:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839717.592171:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bb9 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.592203:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.592212:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839717.592216:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839717.592221:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.592259:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.592273:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839717.592287:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8539:1875734060747392:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839717.592406:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839717.598001:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.598520:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:8539:1875734060747392:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839717.598563:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.598707:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553e00, rc 0) 00000100:00100000:0.0:1788839717.598982:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+12:12475:x1875734050216192:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 6844us (7263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.598992:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:3.0:1788839717.599206:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216320 00000100:00100000:3.0:1788839717.599214:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216320 00010000:00010000:3.0:1788839717.599246:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839717.599280:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:3.0:1788839717.599977:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+12:2390:x1875734050216320:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839717.599992:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839717.600013:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.600028:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.600051:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef901543/0xad5b343a26573b2f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb2 expref: 12 pid: 8538 timeout: 472 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.600067:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839717.600072:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839717.600080:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.600089:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.600138:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839717.600151:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1875734060747520:192.168.203.52@tcp:105: 00000100:00100000:3.0:1788839717.600218:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839717.612963:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.613078:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216448 00000100:00100000:2.0:1788839717.613088:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216448 00002000:00100000:2.0:1788839717.613135:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ab777d4b800 x1875734050216448/t0(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:108/0 lens 504/0 e 0 to 0 dl 1788839728 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839717.613146:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab777d4b800 with x1875734050216448 ext(0->12) 00002000:00010000:2.0:1788839717.613151:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab777d4b800 00000100:00100000:2.0:1788839717.613183:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788839717.613192:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+12:2390:x1875734050216448:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788839717.613981:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6474:1875734060747520:192.168.203.52@tcp:105: 00010000:00010000:0.0:1788839717.614002:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839717.614059:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+14:2390:x1875734050216320:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 14089us (16077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.614067:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1788839717.615283:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+13:2390:x1875734050216448:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 2087us (2326us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788839717.615294:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00002000:00100000:2.0:1788839717.615304:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8ab777d4b800 x1875734050216448/t4294967321(0) o4->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:108/0 lens 504/448 e 0 to 0 dl 1788839728 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788839717.615316:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab777d4b800 with x1875734050216448 ext(0->12) 00002000:00010000:2.0:1788839717.615333:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab777d4b800 00000100:00100000:3.0:1788839717.617349:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.617445:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216576 00000100:00100000:0.0:1788839717.617455:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216576 00000100:00100000:0.0:1788839717.617515:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:0.0:1788839717.617525:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+73:12475:x1875734050216576:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788839717.623854:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788839717.623874:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788839717.623916:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788839717.623932:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab777d793c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788839717.623936:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6478caf00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab777d79840 00000020:00080000:3.0:1788839717.623940:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab6478caa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab64828ee00 00000004:00080000:3.0:1788839717.623965:0:6466:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788839717.623988:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab745d73cc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788839717.623991:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab647977700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab745d73480 00000020:00080000:3.0:1788839717.623993:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab647977200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab6480b0e00 00000020:00080000:3.0:1788839717.624003:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1788839717.624284:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788839717.624347:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788839717.624476:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12475:x1875734050216576:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 6948us (7130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839717.624487:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:2.0:1788839717.625036:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060747776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788839717.625092:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839717.625130:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060747776 00000100:00100000:2.0:1788839717.625137:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060747776 00000100:00100000:2.0:1788839717.625186:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788839717.625194:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060747776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788839717.625217:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1788839717.625239:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.625257:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 12 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.625266:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788839717.625269:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839717.625275:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.625300:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 12 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.625315:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 12 pid: 8403 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.625327:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875734060748032:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839717.625387:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f600 going to sleep for 11 seconds 00000100:00080000:2.0:1788839717.625401:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839717.625416:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839717.625422:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060747648:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788839717.625447:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839717.625468:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060747648 00000100:00100000:2.0:1788839717.625472:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060747648 00000100:00100000:2.0:1788839717.625500:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788839717.625507:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3615:x1875734060747648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788839717.625521:0:8404:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1788839717.625543:0:8404:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f8723, atime: 0x6a9f8724, ctime: 0x6a9f8723, blocks: 0x8 00010000:00010000:2.0:1788839717.625549:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625733:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625750:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625757:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625763:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.625767:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625807:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625822:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8ab7750cef00) 00010000:00010000:1.0:1788839717.625825:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839717.625829:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625835:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959a00/0xad5b343a2657383b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625859:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625865:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625870:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625875:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.625884:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625891:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625900:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8ab647855500) 00010000:00010000:1.0:1788839717.625903:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839717.625906:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625913:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553a00/0xad5b343a265738e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625932:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625939:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625946:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625951:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.625955:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625962:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625970:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:1.0:1788839717.625972:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839717.625981:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.625988:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959200/0xad5b343a26573961 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626002:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626009:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626016:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626020:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.626024:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626030:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626038:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750ced00) 00010000:00010000:1.0:1788839717.626041:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839717.626044:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626050:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573984 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626077:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626093:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626099:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626104:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.626107:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626113:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626121:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.626124:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839717.626127:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626133:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc000/0xad5b343a26573a56 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626146:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626152:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626157:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626162:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.626171:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626177:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626186:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:1.0:1788839717.626189:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788839717.626192:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.626198:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843e00/0xad5b343a26573b13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.626218:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839717.626230:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060747904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788839717.626265:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839717.627498:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=372s v=(0 0) 00010000:00010000:2.0:1788839717.627503:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839717.627512:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.627529:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.627539:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.627547:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788839717.628442:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788839717.628545:0:8404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788839717.628712:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060747904 00000100:00100000:0.0:1788839717.628722:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060747904 00000100:00100000:0.0:1788839717.628796:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788839717.628805:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3617:x1875734060747904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788839717.628943:0:8539:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788839717.628947:0:8539:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788839716 00002000:00010000:0.0:1788839717.628950:0:8539:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788839717.628951:0:8539:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788839716 -> 1788839716 00002000:00010000:0.0:1788839717.628954:0:8539:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788839717.629036:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3617:x1875734060747904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (2770us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788839717.629043:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788839717.629354:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3615:x1875734060747648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3846us (3905us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788839717.629362:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00080000:1.0:1788839717.629494:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab777c37800/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788839717.629502:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060747904:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788839717.629667:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839717.629677:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.629697:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839717.629711:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.629730:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.629750:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.629758:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061df4a18/0xad5b343a26573b44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.629794:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839717.629796:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839717.629798:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839717.630474:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.630866:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216704 00000100:00100000:2.0:1788839717.630873:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216704 00000100:00100000:2.0:1788839717.630917:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:2.0:1788839717.630927:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+13:2389:x1875734050216704:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788839717.631307:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab647b6c380/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788839717.631315:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060747648:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788839717.631591:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8403:1875734060748032:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839717.631614:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839717.639847:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788839717.639862:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1788839717.640063:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050216704:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 9131us (10489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.640075:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1788839717.641207:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.641286:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050216832 00000100:00100000:2.0:1788839717.641295:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050216832 00010000:00010000:2.0:1788839717.641332:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 8 pid: 8403 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.641374:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1788839717.641384:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050216832:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839717.641398:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839717.641403:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 8 pid: 8403 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.641418:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 8 pid: 8403 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.641463:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064d219c1/0xad5b343a265738f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b11 expref: 8 pid: 8403 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.641481:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839717.641486:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788839717.641491:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.641502:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.641534:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839717.641595:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050216832:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 213us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.641603:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00010000:00010000:3.0:1788839717.641894:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.641905:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.641927:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.641935:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.641949:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839717.642136:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060747776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16942us (17043us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788839717.642144:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788839717.642357:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788839717.642364:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1788839717.642385:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab777c37800, transno 4294967322 00000100:00100000:1.0:1788839717.642403:0:3615:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab777c34700 x1875734060747776/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788839733 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788839717.642414:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab777c34700/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788839717.642420:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060747776:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788839717.643378:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839717.643390:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.643403:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839717.643407:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.643418:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.643451:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.643458:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9c95a45/0xad5b343a26573b3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.643479:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839717.643481:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839717.643482:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839717.644986:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.645153:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050217088 00000100:00100000:3.0:1788839717.645161:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050217088 00000100:00100000:3.0:1788839717.645218:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:3.0:1788839717.645227:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12475:x1875734050217088:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.645277:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839717.645301:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573b28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bab expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.645318:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:3.0:1788839717.645322:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839717.645348:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.645361:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.645384:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788839717.645493:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e23f3282 reply state 000000005d88986b transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.645505:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.645511:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:3.0:1788839717.645513:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788839717.645516:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788839717.645765:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+22:12475:x1875734050217088:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 537us (784us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788839717.645799:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:1.0:1788839717.652916:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.653140:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050217216 00000100:00100000:2.0:1788839717.653150:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050217216 00000100:00100000:2.0:1788839717.653259:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1788839717.653270:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2391:x1875734050217216:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788839717.653415:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788839717.653419:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788839716 -> 1788839716 00002000:00010000:2.0:1788839717.653421:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788839716 00002000:00010000:2.0:1788839717.653423:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788839716 -> 1788839716 00002000:00010000:2.0:1788839717.653426:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788839717.653501:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2391:x1875734050217216:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 225us (589us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788839717.653509:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1788839717.661676:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.661911:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050217472 00000100:00100000:3.0:1788839717.661923:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050217472 00000100:00100000:3.0:1788839717.661983:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:3.0:1788839717.661993:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+22:12475:x1875734050217472:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788839717.662059:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.662077:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.662086:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.662121:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.662149:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 22 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839717.662164:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060748160:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839717.662292:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839717.666700:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.667414:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050217600 00000100:00100000:2.0:1788839717.667423:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050217600 00000100:00100000:1.0:1788839717.667432:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060748160:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839717.667460:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667465:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 23 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.667597:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:2.0:1788839717.667609:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+23:2390:x1875734050217600:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839717.667627:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839717.667635:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 23 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667648:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 23 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667671:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842c00/0xad5b343a26573b0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b9d expref: 23 pid: 6488 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667686:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:2.0:1788839717.667691:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667700:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667708:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.667739:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839717.667795:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667805:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.667834:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2390:x1875734050217600:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 227us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.667843:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00010000:00010000:1.0:1788839717.667845:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667854:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667862:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667927:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.667931:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667939:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667948:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:1.0:1788839717.667951:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788839717.667955:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.667973:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553c00/0xad5b343a26573b52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.668014:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12475:x1875734050217472:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 6023us (6347us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788839717.668021:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:1.0:1788839717.671850:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839717.671887:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050217728 00000100:00100000:1.0:1788839717.671896:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050217728 00000100:00100000:1.0:1788839717.671951:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1788839717.671962:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050217728:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788839717.672011:0:8404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.672032:0:8404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.672041:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839717.672045:0:8404:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788839717.672050:0:8404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.672084:0:8404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.672099:0:8404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 8 pid: 8539 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.672129:0:8404:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875734060748288:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839717.672212:0:8404:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788839717.681088:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.681146:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050217856 00000100:00100000:3.0:1788839717.681155:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050217856 00000100:00100000:2.0:1788839717.681173:0:8404:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8404:1875734060748288:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839717.681195:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 9 pid: 8539 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681211:0:8404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839717.681292:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:3.0:1788839717.681302:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+9:2389:x1875734050217856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839717.681316:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839717.681338:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 9 pid: 8539 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.681351:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 9 pid: 8539 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.681374:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f1a8797/0xad5b343a26573b36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bb9 expref: 9 pid: 8539 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.681392:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839717.681405:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839717.681411:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.681421:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.681451:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839717.681502:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2389:x1875734050217856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 201us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.681510:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00010000:00010000:2.0:1788839717.681545:0:8404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681556:0:8404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681595:0:8404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681605:0:8404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681614:0:8404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681622:0:8404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839717.681626:0:8404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681634:0:8404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681647:0:8404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.681662:0:8404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037043b33/0xad5b343a26573b59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.681730:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050217728:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 9769us (9888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.681738:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1788839717.693947:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.694105:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050218112 00000100:00100000:0.0:1788839717.694115:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050218112 00000100:00100000:0.0:1788839717.694185:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:0.0:1788839717.694196:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+21:12475:x1875734050218112:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788839717.694279:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.694317:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 21 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.694328:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.694366:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 21 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.694379:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 21 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.694394:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060748416:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839717.694486:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79300 going to sleep for 11 seconds 00010000:00010000:1.0:1788839717.695490:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839717.705421:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839717.705626:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060748416:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839717.705654:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.706328:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050218240 00000100:00100000:1.0:1788839717.706335:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050218240 00010000:00010000:1.0:1788839717.706372:0:10307:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.706409:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:1.0:1788839717.706418:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2389:x1875734050218240:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839717.706432:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839717.706438:0:10307:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706450:0:10307:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706472:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfce00/0xad5b343a26573a4f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b65 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706487:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.706493:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 21 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706520:0:10307:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706528:0:10307:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706536:0:10307:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.706766:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839717.706931:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.706946:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.707108:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.707121:0:12241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 22 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.707128:0:12241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.707159:0:12241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 22 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839717.707175:0:12241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.707187:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060748544:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839717.707256:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2389:x1875734050218240:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 838us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839717.707264:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:0.0:1788839717.707823:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75ff52e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839717.711944:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.712142:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050218368 00000100:00100000:2.0:1788839717.712152:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050218368 00010000:00010000:2.0:1788839717.712191:0:6472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839717.712235:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:2.0:1788839717.712245:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2390:x1875734050218368:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839717.712259:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839717.712266:0:6472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.712279:0:6472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 22 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.712303:0:6472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:2.0:1788839717.712309:0:6472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.712319:0:6472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.712341:0:6472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839717.712360:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839717.712421:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2390:x1875734050218368:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 177us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.712428:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00010000:00010000:1.0:1788839717.713555:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfd800/0xad5b343a26573b1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ba4 expref: 21 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.713588:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060748544:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839717.714005:0:12241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.714016:0:12241:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.714022:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839717.714132:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1788839717.714252:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788839717.714302:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788839717.714385:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12241:1875734060748672:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788839717.714446:0:12241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839717.714656:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839717.714963:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060748672 00000100:00100000:2.0:1788839717.714970:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060748672 00000100:00100000:2.0:1788839717.715053:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788839717.715062:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12241:x1875734060748672:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788839717.715154:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12241:x1875734060748672:12345-0@lo:1000:mdt00_004.0 Request processed in 93us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839717.715160:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788839717.715220:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12241:1875734060748672:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788839717.715335:0:12241:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1788839717.715383:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12241:1875734060748800:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788839717.715413:0:12241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839717.715520:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839717.715613:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060748800 00000100:00100000:0.0:1788839717.715619:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060748800 00000100:00100000:0.0:1788839717.715645:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788839717.715652:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12241:x1875734060748800:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788839717.715798:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12241:x1875734060748800:12345-0@lo:1000:mdt00_004.0 Request processed in 146us (382us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788839717.715804:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788839717.715905:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12241:1875734060748800:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788839717.715941:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.715950:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.715958:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.715965:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.715970:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.715979:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.715995:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:1.0:1788839717.715998:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839717.716002:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716020:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc600/0xad5b343a26573b67 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716044:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716050:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716055:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716060:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.716062:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716068:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716076:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.716078:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788839717.716086:0:12241:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 24 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716095:0:12241:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 24 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716103:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 24 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.716139:0:12241:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 24 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.716150:0:12241:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060748928:192.168.203.52@tcp:105: 00000100:00100000:1.0:1788839717.716209:0:12241:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839717.725224:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.725377:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050218496 00000100:00100000:3.0:1788839717.725386:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050218496 00000100:00100000:3.0:1788839717.725441:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1788839717.725452:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12474:x1875734050218496:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:3.0:1788839717.725600:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+25:12474:x1875734050218496:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 150us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.725608:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788839717.727257:0:12241:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12241:1875734060748928:192.168.203.52@tcp:105: 00010000:00010000:1.0:1788839717.727284:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727294:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc200/0xad5b343a26573aaa lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727329:0:12241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727342:0:12241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727352:0:12241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727363:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727369:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727375:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727397:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.727401:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727409:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727421:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.727424:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839717.727428:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727433:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b6e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727443:0:12241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727448:0:12241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727454:0:12241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727458:0:12241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfca00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839717.727461:0:12241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727467:0:12241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727485:0:12241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.727487:0:12241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839717.727490:0:12241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.727496:0:12241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfca00/0xad5b343a26573b60 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.727670:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+24:12475:x1875734050218112:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 33476us (33733us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788839717.727680:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000040:00080000:2.0:1788839717.728184:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839717.728189:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839717.728888:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788839717.728898:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:1.0:1788839717.729151:0:12241:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788839717.732420:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.732491:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050218752 00000100:00100000:3.0:1788839717.732501:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050218752 00000100:00100000:3.0:1788839717.732576:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1788839717.732586:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e579450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+24:12475:x1875734050218752:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788839717.733059:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788839717.733095:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788839717.733144:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.733163:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.733174:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.733181:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.733188:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.733194:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.733304:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788839717.733405:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e579450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+26:12475:x1875734050218752:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 819us (996us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788839717.733415:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:3.0:1788839717.733420:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788839717.735364:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839717.735444:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050219008 00000100:00100000:3.0:1788839717.735453:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050219008 00000100:00100000:3.0:1788839717.735510:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:3.0:1788839717.735520:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+26:12474:x1875734050219008:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:3.0:1788839717.735726:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788839717.735820:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+26:12474:x1875734050219008:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 302us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.735828:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 248 00010000:00010000:1.0:1788839717.739314:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839717.739328:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.739339:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839717.739343:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.739353:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.739370:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:1.0:1788839717.739373:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788839717.739378:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.739383:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553e00/0xad5b343a26573b75 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.739418:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839717.739420:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839717.739422:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788839717.761230:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788839717.761246:0:8397:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1788839717.770612:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839717.770766:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050219136 00000100:00100000:1.0:1788839717.770811:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050219136 00000100:00100000:1.0:1788839717.770875:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:1.0:1788839717.770885:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+26:12477:x1875734050219136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1788839717.770911:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839717.770932:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bc0 expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.770994:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771009:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771021:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771036:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771043:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771050:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771142:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771152:0:7438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 27 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771161:0:7438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771194:0:7438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 27 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.771207:0:7438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 27 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.771220:0:7438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060749056:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839717.771311:0:7438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744499180 going to sleep for 11 seconds 00000100:00100000:0.0:1788839717.774079:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839717.774169:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050219392 00000100:00100000:2.0:1788839717.774178:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050219392 00000100:00100000:2.0:1788839717.774234:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1788839717.774243:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+28:6162:x1875734050219392:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788839717.774468:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+29:6162:x1875734050219392:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 225us (397us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788839717.774476:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788839717.775463:0:7438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b58380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7438:1875734060749056:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839717.775490:0:7438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839717.778439:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839717.778616:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050219520 00000100:00100000:1.0:1788839717.778627:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050219520 00010000:00010000:1.0:1788839717.778666:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 29 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839717.778713:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:1.0:1788839717.778734:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+29:2389:x1875734050219520:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839717.778749:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839717.778756:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 29 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.778804:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 29 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.778827:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647bfc400/0xad5b343a26573a9c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b81 expref: 29 pid: 12241 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.778843:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839717.778849:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.778858:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.778866:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839717.778897:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839717.778946:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+28:2389:x1875734050219520:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 213us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839717.778952:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00010000:00010000:3.0:1788839717.779098:0:7438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779106:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839717.779157:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788839717.779162:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839717.779181:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779193:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779203:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779210:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779217:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779223:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839717.779228:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779235:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779244:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:3.0:1788839717.779247:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839717.779250:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779263:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573b83 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779274:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779279:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779284:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779288:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839717.779291:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779297:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779305:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8ab7750cec00) 00010000:00010000:3.0:1788839717.779308:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839717.779310:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779317:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573b8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779361:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a26573b7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bc0 expref: 28 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779376:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bc0 expref: 27 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839717.779391:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:3.0:1788839717.779393:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839717.779396:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959600, rc 0) 00000100:00100000:3.0:1788839717.779424:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12477:x1875734050219136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 8540us (8835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839717.779431:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000040:00080000:0.0:1788839718.506059:0:14676:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839718.506069:0:14676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839718.506100:0:14676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788839718.506107:0:14676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788839718.719906:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788839718.783183:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788839718.783203:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788839718.783233:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788839718.783239:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839718.783370:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060749184:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788839718.783475:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab747bdb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839718.787349:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839718.788758:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050219648 00000100:00100000:1.0:1788839718.788822:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050219648 00000100:00100000:2.0:1788839718.788949:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13767:1875734060749184:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788839718.789369:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:1.0:1788839718.789394:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12489:x1875734050219648:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839718.789436:0:12241:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839718.789578:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12489:x1875734050219648:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 185us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839718.789586:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00080000:3.0:1788839718.793112:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839718.793205:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839718.793303:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050219904 00000100:00100000:2.0:1788839718.793400:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050219904 00000100:00100000:2.0:1788839718.793494:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:2.0:1788839718.793505:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+27:12489:x1875734050219904:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839718.793525:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839718.793554:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573b98 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bc7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839718.793671:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573b9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839718.793826:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839718.793838:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573b9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839718.793849:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788839718.793958:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843000/0xad5b343a26573b98 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bc7 expref: 30 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839718.793979:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573b9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bc7 expref: 29 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839718.794002:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839718.794005:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839718.794009:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843200, rc 0) 00000100:00100000:2.0:1788839718.794140:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+29:12489:x1875734050219904:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 637us (940us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1788839718.794147:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:3.0:1788839718.797345:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839718.797871:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050220160 00000100:00100000:1.0:1788839718.797881:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050220160 00000100:00100000:1.0:1788839718.797937:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:1.0:1788839718.797947:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+29:12489:x1875734050220160:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788839718.798027:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798042:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798053:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798218:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798226:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798231:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798237:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839718.798241:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798260:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798272:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839718.798275:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839718.798279:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.798285:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959000/0xad5b343a26573bad lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839718.798418:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+30:12489:x1875734050220160:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 470us (1080us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788839718.798425:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000040:00080000:3.0:1788839718.799498:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788839718.799504:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839718.800025:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788839718.800034:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839718.802050:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839718.803746:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839718.803868:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050220544 00000100:00100000:1.0:1788839718.803879:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050220544 00000100:00100000:1.0:1788839718.803947:0:10307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788839718.803959:0:10307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+30:2390:x1875734050220544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839718.803975:0:10307:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839718.804000:0:10307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843200/0xad5b343a26573b9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bc7 expref: 30 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839718.804020:0:10307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839718.804025:0:10307:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839718.804073:0:10307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+29:2390:x1875734050220544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 116us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839718.804081:0:10307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788839718.806077:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050220416 00000100:00100000:2.0:1788839718.806090:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050220416 00000100:00100000:2.0:1788839718.806193:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788839718.806204:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+29:12489:x1875734050220416:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839718.806432:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+30:12489:x1875734050220416:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 231us (4390us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788839718.806440:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788839719.296255:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839719.296281:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060749312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839719.296353:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839719.296409:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060749312 00000100:00100000:1.0:1788839719.296417:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060749312 00000100:00100000:1.0:1788839719.296460:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788839719.296469:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060749312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839719.296500:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788839719.296553:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060749312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839719.296569:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788839719.296765:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060749312:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788839719.743124:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839720.578181:0:14727:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839720.578192:0:14727:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839720.578223:0:14727:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788839720.578229:0:14727:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788839720.770942:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839720.778275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839720.778425:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050220800 00000100:00100000:3.0:1788839720.778434:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050220800 00000100:00100000:3.0:1788839720.778520:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:3.0:1788839720.778542:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+30:12509:x1875734050220800:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839720.778575:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839720.778608:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573bb4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bce expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788839720.778874:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788839720.779043:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573bbb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839720.779059:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839720.779076:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573bbb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839720.779088:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788839720.779188:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553200/0xad5b343a26573bb4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bce expref: 33 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839720.779204:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573bbb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bce expref: 32 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839720.779213:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:3.0:1788839720.779216:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788839720.779219:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552800, rc 0) 00000100:00100000:3.0:1788839720.779284:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+32:12509:x1875734050220800:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 755us (1015us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788839720.779292:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:3.0:1788839720.785087:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839720.785150:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050220928 00000100:00100000:1.0:1788839720.785160:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050220928 00000100:00100000:1.0:1788839720.785221:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:1.0:1788839720.785232:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+32:12509:x1875734050220928:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1788839720.785298:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785318:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785330:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785362:0:7438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785368:0:7438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785374:0:7438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785386:0:7438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839720.785390:0:7438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785397:0:7438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785409:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:1.0:1788839720.785412:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839720.785416:0:7438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839720.785422:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959400/0xad5b343a26573bc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839720.785617:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+32:12509:x1875734050220928:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 387us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839720.785626:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:1.0:1788839720.889632:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839720.889705:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221056 00000100:00100000:3.0:1788839720.889715:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221056 00000100:00100000:3.0:1788839720.889821:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1788839720.889832:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2391:x1875734050221056:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788839720.889850:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839720.889871:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022b901f8/0xad5b343a26573bd0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bd5 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788839720.889898:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f8724, atime: 0x6a9f8724, ctime: 0x6a9f8724, blocks: 0x8 00000100:00080000:2.0:1788839720.889917:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788839720.889934:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788839720.889939:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839720.889948:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022b901f8/0xad5b343a26573bd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bd5 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839720.889967:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000022b901f8/0xad5b343a26573bd0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bd5 expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839720.889980:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:2.0:1788839720.890169:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2391:x1875734050221056:12345-192.168.203.52@tcp:101:cat.0 Request processed in 337us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839720.890176:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1788839720.894872:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839720.894965:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221184 00000100:00100000:1.0:1788839720.894975:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221184 00002000:00100000:1.0:1788839720.895026:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ab777c37480 x1875734050221184/t0(0) o3->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:111/0 lens 488/0 e 0 to 0 dl 1788839731 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839720.895037:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab777c37480 with x1875734050221184 ext(0->4095) 00002000:00010000:1.0:1788839720.895042:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab777c37480 00000100:00100000:1.0:1788839720.895073:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1788839720.895083:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2392:x1875734050221184:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:1.0:1788839720.895266:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2392:x1875734050221184:12345-192.168.203.52@tcp:3:cat.0 Request processed in 183us (405us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788839720.895274:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00002000:00100000:1.0:1788839720.895281:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8ab777c37480 x1875734050221184/t0(0) o3->4c22f38d-5944-4459-a83e-bcbd490346fb@192.168.203.52@tcp:111/0 lens 488/4536 e 0 to 0 dl 1788839731 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788839720.895289:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab777c37480 with x1875734050221184 ext(0->4095) 00002000:00010000:1.0:1788839720.895292:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8ab777c37480 00010000:00010000:2.0:1788839721.791955:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839721.855599:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060749696:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.855673:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839721.855722:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060750208:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.855744:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839721.855762:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060750720:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.855814:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839721.855840:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788839721.855846:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060749824:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.855868:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839721.855896:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060750336:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.855919:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839721.855944:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060750848:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.855963:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856236:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060749568:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856262:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856277:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060750080:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856293:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856305:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060750592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856321:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856332:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788839721.856337:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060749440:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856358:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856376:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060749952:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856394:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856406:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060750464:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856421:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856432:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060750976:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856447:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839721.856470:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750208 00000100:00100000:1.0:1788839721.856484:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750208 00000100:00100000:1.0:1788839721.856528:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750720 00000100:00100000:1.0:1788839721.856531:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750720 00000100:00100000:1.0:1788839721.856563:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060749824 00000100:00100000:1.0:1788839721.856566:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060749824 00000100:00100000:1.0:1788839721.856578:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060749568 00000100:00100000:1.0:1788839721.856581:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060749568 00000100:00100000:1.0:1788839721.856589:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750080 00000100:00100000:1.0:1788839721.856591:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750080 00000100:00100000:1.0:1788839721.856600:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750592 00000100:00100000:1.0:1788839721.856601:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750592 00000100:00100000:1.0:1788839721.856614:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788839721.856622:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060750208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.856920:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060750208:12345-0@lo:400:kworker.0 Request processed in 297us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.856995:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788839721.857014:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788839721.857021:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060750720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857053:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060750720:12345-0@lo:400:kworker.0 Request processed in 33us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857058:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788839721.857069:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788839721.857075:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060749824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857099:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060749824:12345-0@lo:400:kworker.0 Request processed in 25us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857105:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788839721.857117:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788839721.857122:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060749568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857169:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060749568:12345-0@lo:400:kworker.0 Request processed in 46us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857175:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788839721.857186:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788839721.857191:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060750080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857215:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060750080:12345-0@lo:400:kworker.0 Request processed in 24us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857220:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788839721.857229:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788839721.857236:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060750592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857258:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060750592:12345-0@lo:400:kworker.0 Request processed in 23us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857262:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788839721.857340:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060749440 00000100:00100000:1.0:1788839721.857346:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060749440 00000100:00100000:1.0:1788839721.857368:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788839721.857373:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060749440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857397:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060749440:12345-0@lo:400:kworker.0 Request processed in 24us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857403:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788839721.857429:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060749696 00000100:00100000:1.0:1788839721.857433:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060749696 00000100:00100000:1.0:1788839721.857449:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060749952 00000100:00100000:1.0:1788839721.857452:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060749952 00000100:00100000:1.0:1788839721.857461:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788839721.857466:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060749696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857503:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060749696:12345-0@lo:400:kworker.0 Request processed in 36us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857509:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788839721.857519:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788839721.857523:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060749952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857559:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060749952:12345-0@lo:400:kworker.0 Request processed in 35us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839721.857565:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788839721.857598:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060749440:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857610:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060749952:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857621:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060749568:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857631:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060750080:0@lo:400:kworker.0 00000100:00100000:1.0:1788839721.857641:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060750592:0@lo:400:kworker.0 00000100:00100000:3.0:1788839721.857837:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750336 00000100:00100000:3.0:1788839721.857843:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750336 00000100:00100000:3.0:1788839721.857874:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750848 00000100:00100000:3.0:1788839721.857876:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750848 00000100:00100000:3.0:1788839721.857888:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750464 00000100:00100000:3.0:1788839721.857890:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750464 00000100:00100000:3.0:1788839721.857900:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060750976 00000100:00100000:3.0:1788839721.857902:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060750976 00000100:00100000:3.0:1788839721.857914:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788839721.857920:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060750336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839721.857959:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060750336:12345-0@lo:400:kworker.0 Request processed in 39us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839721.857966:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788839721.857977:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788839721.857982:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060750848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839721.858004:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060750848:12345-0@lo:400:kworker.0 Request processed in 23us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839721.858010:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788839721.858026:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788839721.858031:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060750464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839721.858060:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060750464:12345-0@lo:400:kworker.0 Request processed in 28us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839721.858065:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788839721.858074:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839721.858080:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060750976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839721.858100:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060750976:12345-0@lo:400:kworker.0 Request processed in 21us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839721.858106:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839721.858162:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060751104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839721.858172:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788839721.858185:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060751232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839721.858194:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839721.858225:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:2.0:1788839721.858226:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788839721.858233:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788839721.858250:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab647bb4e00, transno 4294967308 00000004:00080000:3.0:1788839721.858261:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788839721.858274:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab647b6c380, transno 4294967311 00000100:00100000:3.0:1788839721.858280:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060750464:0@lo:400:kworker.0 00000100:00080000:2.0:1788839721.858287:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839721.858293:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060750976:0@lo:400:kworker.0 00000100:00080000:2.0:1788839721.858299:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839721.858304:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839721.858307:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839721.858325:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751104 00000100:00100000:3.0:1788839721.858330:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751104 00000100:00100000:2.0:1788839721.858332:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751232 00000100:00100000:2.0:1788839721.858339:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751232 00000100:00100000:3.0:1788839721.858362:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788839721.858371:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060751104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839721.858390:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788839721.858426:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875734060751104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839721.858471:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060749824:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.858484:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060750336:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.858494:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060750848:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.858506:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060749696:0@lo:400:kworker.0 00010000:00080000:0.0:1788839721.858521:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486ca680 x1875734060750208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839721.858532:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060750208:0@lo:400:kworker.0 00010000:00080000:0.0:1788839721.858556:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486c9880 x1875734060750720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839721.858566:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060750720:0@lo:400:kworker.0 00000100:00100000:0.0:1788839721.858590:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839721.858596:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060751360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839721.858620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839721.859571:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751360 00000100:00100000:0.0:1788839721.859579:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751360 00000100:00100000:2.0:1788839721.861474:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788839721.861499:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060751232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839721.861569:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839721.861660:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060751232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 173us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839721.861667:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788839721.861756:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060751232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839721.862403:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060751488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839721.862450:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839721.862582:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751488 00000100:00100000:2.0:1788839721.862589:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751488 00000100:00100000:2.0:1788839721.862617:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788839721.862624:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060751488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839721.862639:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788839721.862686:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060751488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839721.862692:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788839721.863356:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060751488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839721.863609:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060751104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839721.875479:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788839721.876637:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788839721.876661:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060751360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839721.876695:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839721.876821:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060751360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 171us (18199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839721.876843:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788839721.876934:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060751360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839722.367026:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060751616:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839722.367104:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839722.367428:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751616 00000100:00100000:3.0:1788839722.367438:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751616 00000100:00100000:3.0:1788839722.367497:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788839722.367507:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060751616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839722.367557:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788839722.367606:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060751616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839722.367614:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788839722.367908:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060751616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839722.672280:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839722.672318:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839722.672400:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221568 00000100:00100000:3.0:1788839722.672414:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839722.672423:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221568 00000100:00100000:3.0:1788839722.672444:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839722.672458:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839722.672475:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839722.672476:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222080 00000100:00100000:2.0:1788839722.672478:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222080 00000100:00100000:3.0:1788839722.672495:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839722.672496:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221440 00000100:00100000:2.0:1788839722.672498:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221440 00000100:00100000:2.0:1788839722.672512:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221952 00000100:00100000:2.0:1788839722.672513:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221952 00000100:00100000:3.0:1788839722.672516:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:3.0:1788839722.672526:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050221568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839722.672526:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 346 00000100:00100000:2.0:1788839722.672531:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050222080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839722.672602:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050222080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839722.672609:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 346 00000100:00100000:0.0:1788839722.672617:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221824 00000100:00100000:0.0:1788839722.672621:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221824 00000100:00100000:2.0:1788839722.672626:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 347 00000100:00100000:2.0:1788839722.672631:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+32:2390:x1875734050221440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839722.672649:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221696 00000100:00100000:0.0:1788839722.672652:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221696 00000100:00100000:1.0:1788839722.672718:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050221312 00000100:00100000:1.0:1788839722.672722:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050221312 00000100:00100000:1.0:1788839722.672751:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 395 00000100:00100000:1.0:1788839722.672758:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050221312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839722.672852:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:0.0:1788839722.672860:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050221824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839722.673389:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050221568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 862us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839722.673397:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 345 00000100:00100000:3.0:1788839722.673415:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 348 00000100:00100000:3.0:1788839722.673423:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050221952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839722.673448:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050221952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839722.673464:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 348 00000100:00100000:3.0:1788839722.673489:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:3.0:1788839722.673496:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050221696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839722.673541:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050221696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839722.673548:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00080000:3.0:1788839722.675725:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839722.675734:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788839722.675737:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839722.675740:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839722.675978:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+32:2390:x1875734050221440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 3338us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839722.675990:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 347 00000100:00100000:1.0:1788839722.680458:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050221312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 7686us (8173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839722.680491:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 395 00000100:00100000:0.0:1788839722.680794:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+8:2390:x1875734050221824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 7933us (8377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839722.680809:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00010000:00010000:1.0:1788839722.817797:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839722.883851:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788839722.883901:0:6466:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab777d79300 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788839722.883907:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab777bd0500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab777d79600 00000020:00080000:3.0:1788839722.883910:0:6466:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab777bd0300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab64833ce00 00000020:00080000:3.0:1788839722.883940:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1788839722.884011:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00010000:00010000:0.0:1788839722.884014:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839722.884025:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839722.884033:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839722.884039:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839722.884044:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839722.884052:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839722.884068:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8ab646801800) 00010000:00010000:0.0:1788839722.884071:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839722.884076:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839722.884093:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26573b4b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788839722.884096:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1788839722.885432:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:2.0:1788839722.885445:0:9483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:2.0:1788839723.845725:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839723.904337:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788839723.904347:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788839723.904365:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788839723.904373:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788839724.420844:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060751744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839724.420917:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839724.420970:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751744 00000100:00100000:3.0:1788839724.420978:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751744 00000100:00100000:3.0:1788839724.421027:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788839724.421036:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060751744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839724.421067:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788839724.421183:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060751744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839724.421191:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788839724.421601:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060751744:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788839724.737661:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839724.869803:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839725.350913:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839725.351159:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222208 00000100:00100000:0.0:1788839725.351168:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222208 00000100:00100000:0.0:1788839725.351244:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:0.0:1788839725.351256:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:12162:x1875734050222208:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788839725.351365:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:12162:x1875734050222208:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 113us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839725.351372:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00080000:3.0:1788839725.351982:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839725.358167:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839725.358268:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222336 00000100:00100000:1.0:1788839725.358279:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222336 00000100:00100000:1.0:1788839725.358358:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00100000:1.0:1788839725.358368:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:12162:x1875734050222336:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788839725.358481:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:12162:x1875734050222336:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 114us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839725.358490:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 256 00000100:00080000:3.0:1788839725.358654:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839725.361378:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839725.361677:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222592 00000100:00100000:2.0:1788839725.361686:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222592 00000100:00100000:2.0:1788839725.361754:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1788839725.361764:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:12162:x1875734050222592:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839725.363049:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:12162:x1875734050222592:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1281us (1673us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788839725.363061:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1788839725.725871:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839725.726034:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222720 00000100:00100000:1.0:1788839725.726044:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222720 00000100:00100000:1.0:1788839725.726122:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 257 00000100:00100000:1.0:1788839725.726132:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:12967:x1875734050222720:12345-192.168.203.52@tcp:101:lsof.0 00000100:00080000:3.0:1788839725.726256:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788839725.726343:0:7438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839725.726367:0:7438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573bd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bdc expref: -99 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839725.726431:0:7438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573bde lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839725.726461:0:7438:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839725.726476:0:7438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839725.726543:0:7438:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788839725.726547:0:7438:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788839725.726570:0:7438:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573bde lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7438 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839725.726592:0:7438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a26573bd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bdc expref: 7 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839725.726611:0:7438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573bde lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bdc expref: 6 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839725.726619:0:7438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:1.0:1788839725.726622:0:7438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839725.726626:0:7438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958600, rc 0) 00000100:00100000:1.0:1788839725.726693:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+6:12967:x1875734050222720:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 562us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839725.726701:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 257 00010000:00010000:2.0:1788839725.887019:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839726.911049:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839726.975080:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839726.975118:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060751872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839726.975186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839726.975570:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060751872 00000100:00100000:3.0:1788839726.975578:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060751872 00000100:00100000:3.0:1788839726.975624:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788839726.975635:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060751872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839726.975662:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839726.975705:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060751872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839726.975711:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1788839726.975730:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839726.975848:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060752000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839726.975942:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839726.975992:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752000 00000100:00100000:2.0:1788839726.975996:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752000 00000100:00100000:2.0:1788839726.976023:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788839726.976030:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060752000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839726.976046:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788839726.976078:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060752000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839726.976084:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788839726.976229:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839726.976251:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1788839726.976256:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab777c34700, transno 4294967323 00000004:00080000:2.0:1788839726.976265:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1788839726.976288:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060752000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839726.976467:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060752128:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839726.976496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839726.976553:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752128 00000100:00100000:1.0:1788839726.976558:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752128 00000100:00100000:1.0:1788839726.976584:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788839726.976605:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060752128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788839726.976617:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788839726.976650:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060752128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839726.976656:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788839726.976685:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060752128:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788839726.976699:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839726.976813:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060751872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839726.977483:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060752640:0@lo:400:kworker.0 00000100:00100000:3.0:1788839726.977534:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839726.977553:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060753152:0@lo:400:kworker.0 00000100:00100000:3.0:1788839726.977587:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839726.977611:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788839726.977617:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060752512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839726.977638:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839726.977656:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060753024:0@lo:400:kworker.0 00000100:00100000:3.0:1788839726.977674:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839726.977686:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060753536:0@lo:400:kworker.0 00000100:00100000:3.0:1788839726.977715:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839726.977861:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752640 00000100:00100000:2.0:1788839726.977876:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752640 00000100:00100000:2.0:1788839726.977913:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788839726.977921:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060752640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839726.977964:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060752640:12345-0@lo:400:kworker.0 Request processed in 43us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839726.977970:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788839726.977995:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060752384:0@lo:400:kworker.0 00000100:00100000:2.0:1788839726.978038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839726.978072:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060752896:0@lo:400:kworker.0 00000100:00100000:2.0:1788839726.978094:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839726.978112:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060753408:0@lo:400:kworker.0 00000100:00100000:2.0:1788839726.978138:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752384 00000100:00100000:2.0:1788839726.978141:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752384 00000100:00100000:2.0:1788839726.978168:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788839726.978174:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060752384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839726.978206:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060752384:12345-0@lo:400:kworker.0 Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839726.978213:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788839726.978237:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752896 00000100:00100000:2.0:1788839726.978241:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752896 00000100:00100000:2.0:1788839726.978260:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788839726.978265:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060752896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839726.978293:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060752896:12345-0@lo:400:kworker.0 Request processed in 28us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839726.978299:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788839726.978386:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060752640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839726.978456:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060752256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839726.978487:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839726.978515:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060752768:0@lo:400:kworker.0 00000100:00100000:1.0:1788839726.978536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839726.986135:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060753280:0@lo:400:kworker.0 00000100:00100000:1.0:1788839726.986204:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839726.986254:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752256 00000100:00100000:1.0:1788839726.986262:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752256 00000100:00100000:1.0:1788839726.986319:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788839726.986328:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060752256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788839726.986354:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788839726.986396:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060752256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (7908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839726.986403:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:1.0:1788839726.986421:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839726.986453:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060752256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839726.987281:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753152 00000100:00100000:0.0:1788839726.987289:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753152 00000100:00100000:0.0:1788839726.987340:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752512 00000100:00100000:0.0:1788839726.987343:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752512 00000100:00100000:0.0:1788839726.987357:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753024 00000100:00100000:0.0:1788839726.987359:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753024 00000100:00100000:0.0:1788839726.987371:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753536 00000100:00100000:0.0:1788839726.987373:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753536 00000100:00100000:0.0:1788839726.987385:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060752768 00000100:00100000:0.0:1788839726.987388:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060752768 00000100:00100000:0.0:1788839726.987401:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788839726.987409:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060753152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.987472:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060753152:12345-0@lo:400:kworker.0 Request processed in 63us (9892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.987479:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788839726.987494:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788839726.987501:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060752512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.987556:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060752512:12345-0@lo:400:kworker.0 Request processed in 55us (9916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.987561:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788839726.987574:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788839726.987580:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060753024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.987607:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875734060753024:12345-0@lo:400:kworker.0 Request processed in 27us (9932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.987612:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788839726.987623:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788839726.987629:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060753536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.987655:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060753536:12345-0@lo:400:kworker.0 Request processed in 27us (9939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.987661:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788839726.987673:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788839726.987678:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060752768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.987711:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060752768:12345-0@lo:400:kworker.0 Request processed in 33us (9173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.987717:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788839726.988190:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753280 00000100:00100000:0.0:1788839726.988197:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753280 00000100:00100000:0.0:1788839726.988229:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788839726.988236:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060753280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988273:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060753280:12345-0@lo:400:kworker.0 Request processed in 38us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.988280:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788839726.988307:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839726.988311:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839726.988341:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060752512:0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988353:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875734060753024:0@lo:400:kworker.0 00010000:00080000:0.0:1788839726.988367:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819f9880 x1875734060753536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839726.988376:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060753536:0@lo:400:kworker.0 00010000:00080000:0.0:1788839726.988388:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb800 x1875734060753152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839726.988395:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060753152:0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988453:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060752768:0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988461:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060753280:0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988499:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839726.988549:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060752384:0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988560:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060752896:0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988580:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753408 00000100:00100000:0.0:1788839726.988584:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753408 00000100:00100000:0.0:1788839726.988610:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788839726.988616:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060753408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839726.988650:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060753408:12345-0@lo:400:kworker.0 Request processed in 34us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839726.988656:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00080000:0.0:1788839726.988671:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839726.988693:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060753408:0@lo:400:kworker.0 00000100:00100000:2.0:1788839727.487151:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839727.487188:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060753664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839727.487265:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839727.487463:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753664 00000100:00100000:1.0:1788839727.487477:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753664 00000100:00100000:1.0:1788839727.487538:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788839727.487547:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060753664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839727.487578:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788839727.487625:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060753664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839727.487632:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788839727.487724:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060753664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839727.788226:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839727.788278:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839727.788304:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839727.788367:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223104 00000100:00100000:1.0:1788839727.788373:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839727.788379:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223104 00000100:00100000:1.0:1788839727.788402:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839727.788424:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839727.788452:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223616 00000100:00100000:0.0:1788839727.788456:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223616 00000100:00100000:2.0:1788839727.788473:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222848 00000100:00100000:2.0:1788839727.788479:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222848 00000100:00100000:0.0:1788839727.788492:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050222976 00000100:00100000:0.0:1788839727.788496:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050222976 00000100:00100000:2.0:1788839727.788535:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 397 00000100:00100000:0.0:1788839727.788535:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 355 00000100:00100000:0.0:1788839727.788552:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050223104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839727.788553:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050222848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839727.788630:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+13:2389:x1875734050222848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 85us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839727.788637:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 397 00000100:00100000:3.0:1788839727.794969:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223360 00000100:00100000:3.0:1788839727.794987:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223360 00000100:00100000:0.0:1788839727.795222:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050223104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 6670us (6936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839727.795235:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 355 00000100:00100000:0.0:1788839727.795277:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 356 00000100:00100000:0.0:1788839727.795292:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050223616:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839727.795334:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839727.795349:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+5:2389:x1875734050223616:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (6978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839727.795357:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 356 00000100:00100000:1.0:1788839727.795367:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223232 00000100:00100000:0.0:1788839727.795372:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223488 00000100:00100000:1.0:1788839727.795373:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223232 00000100:00100000:0.0:1788839727.795379:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223488 00000100:00100000:0.0:1788839727.795415:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 357 00000100:00100000:0.0:1788839727.795422:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:2389:x1875734050222976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839727.795428:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1788839727.795440:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050223232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839727.795478:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:2389:x1875734050222976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (7064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839727.795479:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2389:x1875734050223232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (7053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839727.795490:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 357 00000100:00100000:0.0:1788839727.795515:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 358 00000100:00100000:0.0:1788839727.795523:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:2389:x1875734050223488:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839727.795563:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:2389:x1875734050223488:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839727.795572:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 358 00000100:00100000:3.0:1788839727.795610:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:3.0:1788839727.795619:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050223360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839727.795662:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2389:x1875734050223360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (7357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839727.795668:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:1.0:1788839727.795698:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00080000:0.0:1788839727.796685:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839727.796692:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788839727.796694:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788839727.796697:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788839727.935150:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839728.959847:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788839729.026576:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788839729.026590:0:6466:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788839729.026609:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788839729.026619:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:2.0:1788839729.372564:0:14926:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:55:27 (1788839727) 00000100:00100000:0.0:1788839729.546703:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060753792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839729.546794:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839729.546871:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753792 00000100:00100000:0.0:1788839729.546878:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753792 00000100:00100000:0.0:1788839729.546920:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788839729.546929:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060753792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839729.546959:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839729.547019:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060753792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839729.547027:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788839729.547077:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060753792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788839729.982997:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839731.011047:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839732.031022:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839732.095707:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060753920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839732.095802:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839732.095886:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839732.095895:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060754048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839732.095920:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.096103:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060753920 00000100:00100000:3.0:1788839732.096110:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060753920 00000100:00100000:3.0:1788839732.096155:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754048 00000100:00100000:3.0:1788839732.096158:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754048 00000100:00100000:3.0:1788839732.096175:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788839732.096185:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060753920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839732.096227:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788839732.096283:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060753920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839732.096291:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788839732.096308:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788839732.096313:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060754048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839732.096327:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839732.096355:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060754048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839732.096362:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1788839732.096378:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839732.096395:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839732.096408:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060754176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839732.096430:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.096464:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060754048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839732.096523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060753920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839732.096538:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754176 00000100:00100000:3.0:1788839732.096541:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754176 00000100:00100000:3.0:1788839732.096564:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788839732.096569:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060754176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839732.096580:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788839732.096611:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060754176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839732.096617:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788839732.096630:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788839732.096648:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060754176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839732.097310:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060754560:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.097350:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839732.097383:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060755072:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.097418:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839732.097444:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788839732.097450:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060754688:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.097481:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839732.097497:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060755200:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.097516:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839732.099026:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754560 00000100:00100000:0.0:1788839732.099036:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754560 00000100:00100000:0.0:1788839732.099082:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788839732.099100:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060754560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.099163:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060754560:12345-0@lo:400:kworker.0 Request processed in 64us (1812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.099169:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788839732.099202:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755072 00000100:00100000:0.0:1788839732.099205:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755072 00000100:00100000:0.0:1788839732.099237:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754688 00000100:00100000:0.0:1788839732.099239:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754688 00000100:00100000:0.0:1788839732.099254:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788839732.099259:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060755072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.099286:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060755072:12345-0@lo:400:kworker.0 Request processed in 27us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.099291:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788839732.099301:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788839732.099306:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060754688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.099326:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060754688:12345-0@lo:400:kworker.0 Request processed in 20us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.099331:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788839732.099348:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755200 00000100:00100000:0.0:1788839732.099350:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755200 00000100:00100000:0.0:1788839732.099372:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788839732.099377:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060755200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.099400:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060755200:12345-0@lo:400:kworker.0 Request processed in 23us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.099405:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788839732.100695:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060754304:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.100758:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.100838:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060754816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.100865:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.100881:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060755328:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.100904:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.100924:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788839732.100931:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060754432:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.100953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.100968:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060754944:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.101004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.101020:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060755456:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.101039:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839732.101065:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839732.101071:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788839732.101077:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839732.101086:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060755584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839732.101112:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.101141:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755584 00000100:00100000:3.0:1788839732.101147:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755584 00000100:00100000:3.0:1788839732.101180:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839732.101188:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060755584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788839732.101207:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788839732.101244:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060755584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839732.101250:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839732.101293:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060755584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839732.103191:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754304 00000100:00100000:0.0:1788839732.103203:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754304 00000100:00100000:0.0:1788839732.103298:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788839732.103308:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060754304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.103387:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3616:x1875734060754304:12345-0@lo:400:kworker.0 Request processed in 82us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.103394:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788839732.103434:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754816 00000100:00100000:0.0:1788839732.103438:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754816 00000100:00100000:0.0:1788839732.103464:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788839732.103485:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060754816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.103520:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060754816:12345-0@lo:400:kworker.0 Request processed in 50us (2654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.103526:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788839732.103546:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755328 00000100:00100000:0.0:1788839732.103550:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755328 00000100:00100000:0.0:1788839732.103581:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754432 00000100:00100000:0.0:1788839732.103584:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754432 00000100:00100000:0.0:1788839732.103596:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060754944 00000100:00100000:0.0:1788839732.103598:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060754944 00000100:00100000:0.0:1788839732.103611:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755456 00000100:00100000:0.0:1788839732.103614:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755456 00000100:00100000:0.0:1788839732.103627:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788839732.103632:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060755328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.103665:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060755328:12345-0@lo:400:kworker.0 Request processed in 33us (2760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.103672:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788839732.103683:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788839732.103688:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060754432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.103717:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060754432:12345-0@lo:400:kworker.0 Request processed in 29us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.103731:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788839732.103744:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788839732.103749:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060754944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.103813:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060754944:12345-0@lo:400:kworker.0 Request processed in 64us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.103819:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788839732.103831:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788839732.103837:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060755456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839732.103862:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060755456:12345-0@lo:400:kworker.0 Request processed in 26us (2822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.103867:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:3.0:1788839732.104174:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839732.104179:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839732.104216:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060754432:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.104230:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060754944:0@lo:400:kworker.0 00010000:00080000:3.0:1788839732.104243:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777ca8e00 x1875734060755456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839732.104253:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060755456:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.104263:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060754304:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.104286:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060754816:0@lo:400:kworker.0 00000100:00100000:3.0:1788839732.104296:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060755328:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.104545:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060754688:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.104557:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060755200:0@lo:400:kworker.0 00000100:00100000:1.0:1788839732.104568:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060754560:0@lo:400:kworker.0 00010000:00080000:1.0:1788839732.104578:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777eedc00 x1875734060755072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839732.104587:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060755072:0@lo:400:kworker.0 00000100:00100000:2.0:1788839732.607524:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839732.607549:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060755712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839732.607615:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839732.608993:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755712 00000100:00100000:3.0:1788839732.609007:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755712 00000100:00100000:3.0:1788839732.609075:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788839732.609085:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060755712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839732.609124:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788839732.609227:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060755712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839732.609235:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788839732.609403:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060755712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839732.908643:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839732.908694:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839732.908721:0:6480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223744 00000100:00100000:0.0:1788839732.908731:0:6480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223744 00000100:00100000:2.0:1788839732.908738:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839732.908767:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839732.908837:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839732.908841:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 399 00000100:00100000:0.0:1788839732.908856:0:6480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050223744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839732.908879:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050224256 00000100:00100000:2.0:1788839732.908885:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050224256 00000100:00100000:0.0:1788839732.908928:0:6480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a94babf6-f8ea-4a10-a503-aad078d53639+13:2390:x1875734050223744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.908937:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 399 00000100:00100000:1.0:1788839732.908950:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050224000 00000100:00100000:1.0:1788839732.908956:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050224000 00000100:00100000:0.0:1788839732.909064:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050224512 00000100:00100000:0.0:1788839732.909068:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050224512 00000100:00100000:2.0:1788839732.914310:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:2.0:1788839732.914339:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050224256:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839732.914439:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2390:x1875734050224256:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 116us (5703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839732.914459:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:2.0:1788839732.914824:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050223872 00000100:00100000:2.0:1788839732.914834:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050223872 00000100:00100000:1.0:1788839732.918710:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 365 00000100:00100000:1.0:1788839732.918729:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050224000:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839732.919675:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050224000:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 934us (10963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839732.919686:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 365 00000100:00080000:3.0:1788839732.930852:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839732.930865:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839732.930869:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839732.941084:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839732.941142:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839732.941178:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050224128 00000100:00100000:1.0:1788839732.941188:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050224128 00000100:00100000:1.0:1788839732.941269:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788839732.941295:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050224128:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839732.941378:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2390:x1875734050224128:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839732.941386:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788839732.941425:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050224384 00000100:00100000:1.0:1788839732.941429:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050224384 00000100:00100000:1.0:1788839732.941482:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 366 00000100:00100000:1.0:1788839732.941490:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:2390:x1875734050224384:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839732.941519:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:2390:x1875734050224384:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839732.941526:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 366 00000100:00080000:3.0:1788839732.941985:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839732.941992:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839732.942909:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 367 00000100:00100000:0.0:1788839732.942922:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050224512:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839732.942986:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2390:x1875734050224512:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (34219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839732.943009:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 367 00000100:00100000:2.0:1788839732.944076:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 368 00000100:00100000:2.0:1788839732.944490:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2390:x1875734050223872:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839732.944566:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+18:2390:x1875734050223872:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 481us (35730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839732.944574:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 368 00010000:00010000:3.0:1788839733.055430:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839733.118987:0:13767:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788839733.118996:0:13767:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788839733.119103:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788839733.119110:0:13767:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788839733.670988:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839733.673655:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050224768 00000100:00100000:2.0:1788839733.673672:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050224768 00000100:00100000:2.0:1788839733.673745:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788839733.673757:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+18:13190:x1875734050224768:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1788839733.674062:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+19:13190:x1875734050224768:12345-192.168.203.52@tcp:35:umount.0 Request processed in 306us (3084us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788839733.674071:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1788839733.677683:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839733.678406:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050225024 00000100:00100000:3.0:1788839733.678416:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050225024 00000100:00100000:3.0:1788839733.678494:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1788839733.678504:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+19:13190:x1875734050225024:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:3.0:1788839733.678839:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+20:13190:x1875734050225024:12345-192.168.203.52@tcp:35:umount.0 Request processed in 336us (1164us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788839733.678847:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1788839733.682220:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839733.684799:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050225280 00000100:00100000:2.0:1788839733.684811:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050225280 00000100:00100000:2.0:1788839733.684882:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788839733.684890:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e579850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+20:13190:x1875734050225280:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1788839733.685101:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e579850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+21:13190:x1875734050225280:12345-192.168.203.52@tcp:35:umount.0 Request processed in 211us (2888us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788839733.685109:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788839733.701629:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839733.701823:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050225536 00000100:00100000:0.0:1788839733.701834:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050225536 00000100:00100000:0.0:1788839733.701885:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1788839733.701894:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+21:13190:x1875734050225536:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1788839733.702154:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4c22f38d-5944-4459-a83e-bcbd490346fb+22:13190:x1875734050225536:12345-192.168.203.52@tcp:35:umount.0 Request processed in 260us (545us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788839733.702162:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788839733.715866:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839733.715905:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839733.716181:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050225664 00000100:00100000:0.0:1788839733.716190:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050225664 00000100:00100000:0.0:1788839733.716249:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050225792 00000100:00100000:0.0:1788839733.716253:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050225792 00000100:00100000:0.0:1788839733.716286:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788839733.716297:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+14:2391:x1875734050225664:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839733.716320:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839733.716341:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842600/0xad5b343a26572bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7472f expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839733.716358:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839733.716407:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+13:2391:x1875734050225664:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 112us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839733.716416:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1788839733.716449:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788839733.716455:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+12:2391:x1875734050225792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839733.716473:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839733.716483:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552000/0xad5b343a26572af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e746f0 expref: 12 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839733.716492:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839733.716510:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+11:2391:x1875734050225792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 56us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839733.716516:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788839733.720603:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839733.720651:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839733.720929:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050226304 00000100:00100000:0.0:1788839733.720938:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050226304 00000100:00100000:0.0:1788839733.720991:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1788839733.720999:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+7:2388:x1875734050226304:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:0.0:1788839733.721028:0:8539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26573149 00000020:00010000:0.0:1788839733.721035:0:8539:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab64809f800: total 0 00000100:00080000:0.0:1788839733.721039:0:8539:0:(import.c:65:import_set_state_nolock()) ffff8ab64809c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839733.721076:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788839733.721227:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2388:x1875734050226304:12345-192.168.203.52@tcp:9:umount.0 Request processed in 228us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839733.721234:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:3.0:1788839733.722550:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050225920 00000100:00100000:3.0:1788839733.722561:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050225920 00000100:00100000:3.0:1788839733.722991:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788839733.723001:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a94babf6-f8ea-4a10-a503-aad078d53639+11:2389:x1875734050225920:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839733.723016:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839733.723035:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6c00/0xad5b343a26572dd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74808 expref: 11 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839733.723051:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00010000:1.0:1788839733.723233:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab64809f800: total 0 00010000:00010000:1.0:1788839733.723294:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab64809f800, canceled 0 locks, left on hash table 2. 00000100:00100000:3.0:1788839733.723803:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a94babf6-f8ea-4a10-a503-aad078d53639+10:2389:x1875734050225920:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 800us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839733.723814:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:1.0:1788839733.724102:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022b901f8/0xad5b343a26573bd0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bd5 expref: 4 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839733.724265:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006f9f45f/0xad5b343a26573501 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749f2 expref: 3 pid: 8538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839733.724283:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab64809f800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788839733.724314:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839733.724316:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839733.724386:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839733.733268:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839733.733339:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050226432 00000100:00100000:3.0:1788839733.733349:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050226432 00000100:00100000:3.0:1788839733.733409:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1788839733.733420:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2388:x1875734050226432:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:3.0:1788839733.733471:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572ed3 00000100:00080000:3.0:1788839733.733481:0:8405:0:(import.c:65:import_set_state_nolock()) ffff8ab64816d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839733.733533:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788839733.733709:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839733.734051:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4c22f38d-5944-4459-a83e-bcbd490346fb+2:2388:x1875734050226432:12345-192.168.203.52@tcp:9:umount.0 Request processed in 631us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839733.734059:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1788839733.744212:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839733.744325:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050227456 00000100:00100000:1.0:1788839733.744335:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050227456 00000100:00100000:1.0:1788839733.744399:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 258 00000100:00100000:1.0:1788839733.744411:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+22:2388:x1875734050227456:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788839733.744448:0:12241:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572b06 00000020:00010000:1.0:1788839733.744473:0:12241:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab647a22800: total 0 00000100:00080000:1.0:1788839733.744478:0:12241:0:(import.c:65:import_set_state_nolock()) ffff8ab647a25800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839733.744514:0:12241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1788839733.744887:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:4c22f38d-5944-4459-a83e-bcbd490346fb+21:2388:x1875734050227456:12345-192.168.203.52@tcp:39:umount.0 Request processed in 477us (685us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1788839733.744895:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 258 00000020:00010000:2.0:1788839733.745429:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab647a22800: total 0 00010000:00010000:2.0:1788839733.745434:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839733.745543:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab647a22800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788839733.745759:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839733.745764:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839733.745805:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552c00/0xad5b343a26573ab1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74b88 expref: 20 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745831:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839733.745835:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788839733.745840:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265734ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749eb expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745854:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839733.745857:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839733.745861:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842a00/0xad5b343a265731a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7490b expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745873:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab64784f300) 00010000:00010000:2.0:1788839733.745875:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839733.745879:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6a00/0xad5b343a26572e4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e7481d expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745896:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:2.0:1788839733.745899:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788839733.745903:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26573586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a15 expref: 16 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745939:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839733.745941:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839733.745946:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647842000/0xad5b343a265733e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749a5 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745958:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647850000) 00010000:00010000:2.0:1788839733.745960:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839733.745964:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab7413ca800/0xad5b343a26572e32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74816 expref: 14 pid: 12241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745979:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839733.745981:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839733.745985:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26573b91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bc0 expref: 13 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.745996:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8ab647855e00) 00010000:00010000:2.0:1788839733.745998:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788839733.746002:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a26573bbb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bce expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.746016:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8ab747cc7300) 00010000:00010000:2.0:1788839733.746018:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788839733.746021:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26573873 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74aee expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.746033:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:2.0:1788839733.746035:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839733.746044:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647843400/0xad5b343a2657356a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74a0e expref: 10 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.746058:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8ab647851900) 00010000:00010000:2.0:1788839733.746060:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788839733.746063:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a26572ea9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74832 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.746078:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8ab777ad0f00) 00010000:00010000:2.0:1788839733.746080:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839733.746083:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a265734c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e749dd expref: 8 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839733.746095:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab647a22800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788839733.746113:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839733.746115:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839733.746116:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839733.753704:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839733.753812:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050227584 00000100:00100000:1.0:1788839733.753821:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050227584 00000100:00100000:1.0:1788839733.753873:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 259 00000100:00100000:1.0:1788839733.753883:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+5:2388:x1875734050227584:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:1.0:1788839733.753916:0:6488:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572b0d 00000100:00080000:1.0:1788839733.753932:0:6488:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839733.753961:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788839733.754115:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4c22f38d-5944-4459-a83e-bcbd490346fb+3:2388:x1875734050227584:12345-192.168.203.52@tcp:39:umount.0 Request processed in 232us (420us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788839733.754122:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 259 00010000:00010000:0.0:1788839733.754754:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839734.079217:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839734.655317:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839734.670021:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060755840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839734.670103:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839734.670982:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755840 00000100:00100000:0.0:1788839734.670992:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755840 00000100:00100000:0.0:1788839734.671050:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788839734.671060:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060755840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839734.671106:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788839734.671172:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060755840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839734.671180:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788839734.674334:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060755840:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788839734.980533:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788839735.103161:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839735.823113:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839735.823153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839735.823193:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839735.823287:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050227712 00000100:00100000:0.0:1788839735.823292:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050227968 00000100:00100000:1.0:1788839735.823295:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050227712 00000100:00100000:0.0:1788839735.823299:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050227968 00000100:00100000:1.0:1788839735.823364:0:10307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050227840 00000100:00100000:1.0:1788839735.823368:0:10307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050227840 00000100:00100000:2.0:1788839735.823374:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788839735.823387:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a94babf6-f8ea-4a10-a503-aad078d53639+12:2391:x1875734050227712:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839735.823403:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839735.823425:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782078e00/0xad5b343a26572c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74744 expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839735.823452:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839735.823527:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a94babf6-f8ea-4a10-a503-aad078d53639+11:2391:x1875734050227712:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 143us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839735.823535:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839735.827080:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788839735.827101:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a94babf6-f8ea-4a10-a503-aad078d53639+11:2390:x1875734050227968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839735.827121:0:6472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839735.827145:0:6472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413cba00/0xad5b343a26572dc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74801 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839735.827162:0:6472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839735.828801:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788839735.828825:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+10:2391:x1875734050227840:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839735.828854:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839735.828882:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6000/0xad5b343a26572c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74775 expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839735.828899:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839735.829071:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a94babf6-f8ea-4a10-a503-aad078d53639+9:2390:x1875734050227968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1978us (5914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839735.829081:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788839735.829128:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d08c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a94babf6-f8ea-4a10-a503-aad078d53639+8:2391:x1875734050227840:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 309us (5931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839735.829136:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788839735.832747:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839735.833836:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050228224 00000100:00100000:0.0:1788839735.833850:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050228224 00000100:00080000:3.0:1788839735.833900:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788839735.833926:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 260 00000100:00100000:0.0:1788839735.833939:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+6:2388:x1875734050228224:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:0.0:1788839735.833981:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572c25 00000020:00010000:0.0:1788839735.833989:0:6487:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab647b17800: total 0 00000100:00080000:0.0:1788839735.833994:0:6487:0:(import.c:65:import_set_state_nolock()) ffff8ab647b12800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788839735.834031:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1788839735.834103:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab647b17800: total 0 00010000:00010000:3.0:1788839735.834167:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab647b17800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788839735.834204:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646801900) 00010000:00010000:3.0:1788839735.834208:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839735.834217:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958600/0xad5b343a26573bde lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bdc expref: 5 pid: 7438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839735.834239:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab647b17800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788839735.834252:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839735.834254:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839735.834255:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839735.834349:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:369e11fa-e360-4215-b9ed-184f44a2087d+3:2388:x1875734050228224:12345-192.168.203.52@tcp:39:umount.0 Request processed in 413us (1611us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1788839735.834375:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 260 00000100:00100000:3.0:1788839735.844551:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839735.844819:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050228352 00000100:00100000:0.0:1788839735.844829:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050228352 00000100:00100000:0.0:1788839735.844894:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 261 00000100:00080000:3.0:1788839735.844900:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839735.844907:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+5:2388:x1875734050228352:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:0.0:1788839735.844948:0:7438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572c1e 00000100:00080000:0.0:1788839735.844957:0:7438:0:(import.c:65:import_set_state_nolock()) ffff8ab777c24000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788839735.845081:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788839735.845258:0:7438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788839735.845425:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:369e11fa-e360-4215-b9ed-184f44a2087d+3:2388:x1875734050228352:12345-192.168.203.52@tcp:39:umount.0 Request processed in 520us (881us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788839735.845433:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 261 00000100:00100000:3.0:1788839735.876390:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839735.876522:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050228608 00000100:00100000:2.0:1788839735.876531:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050228608 00000100:00100000:2.0:1788839735.876591:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 400 00000100:00100000:2.0:1788839735.876602:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+7:2388:x1875734050228608:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:2.0:1788839735.876645:0:6479:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572ae3 00000020:00010000:2.0:1788839735.876653:0:6479:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab646b3b000: total 0 00000100:00080000:2.0:1788839735.876658:0:6479:0:(import.c:65:import_set_state_nolock()) ffff8ab646b39800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788839735.876739:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775075850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a94babf6-f8ea-4a10-a503-aad078d53639+3:2388:x1875734050228608:12345-192.168.203.52@tcp:251:umount.0 Request processed in 138us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839735.876747:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 400 00000020:00010000:1.0:1788839735.876941:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab646b3b000: total 0 00010000:00010000:1.0:1788839735.876946:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839735.876994:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab646b3b000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788839735.877029:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740030a00/0xad5b343a26572bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74736 expref: 2 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839735.877045:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab646b3b000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788839735.877056:0:6476:0:(genops.c:885:class_export_put()) final put ffff8ab646b3b000/a94babf6-f8ea-4a10-a503-aad078d53639 00010000:00010000:1.0:1788839735.877075:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839735.877078:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839735.877080:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839735.877114:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3b000/a94babf6-f8ea-4a10-a503-aad078d53639 for MGS 00000020:00000080:2.0:1788839735.877152:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b39800 for MGS 00010000:00010000:3.0:1788839736.127958:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839737.158170:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839737.221956:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060756096:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.222029:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.222096:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756096 00000100:00100000:2.0:1788839737.222104:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756096 00000100:00100000:2.0:1788839737.222165:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788839737.222174:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060756096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.223389:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060755968:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.223451:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.223479:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060756480:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.223501:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.223514:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060756992:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.223531:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.223542:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060757504:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.223560:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.223583:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788839737.223589:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060756352:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.223610:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.223641:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060756864:0@lo:400:kworker.0 00000100:00100000:3.0:1788839737.225881:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060757888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839737.229686:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060756096:12345-0@lo:400:kworker.0 Request processed in 7502us (7646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.229701:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788839737.229735:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756352 00000100:00100000:2.0:1788839737.229743:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756352 00000100:00100000:2.0:1788839737.229802:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788839737.229812:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060756352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.229861:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060756352:12345-0@lo:400:kworker.0 Request processed in 50us (6249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.229882:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788839737.229923:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060756608:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.229962:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.229990:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060757120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230010:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.230026:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060757632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839737.230051:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.230088:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060756096:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230109:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788839737.230114:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060756224:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230139:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.230157:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060756736:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230189:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.230207:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060757248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230231:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.230248:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060757760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839737.230267:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.230294:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756608 00000100:00100000:2.0:1788839737.230298:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756608 00000100:00100000:2.0:1788839737.230325:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757120 00000100:00100000:2.0:1788839737.230328:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757120 00000100:00100000:2.0:1788839737.230341:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756736 00000100:00100000:2.0:1788839737.230343:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756736 00000100:00100000:2.0:1788839737.230351:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757248 00000100:00100000:2.0:1788839737.230353:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757248 00000100:00100000:2.0:1788839737.230385:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788839737.230391:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060756608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230448:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060756608:12345-0@lo:400:kworker.0 Request processed in 57us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230454:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788839737.230468:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788839737.230474:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060757120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230501:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060757120:12345-0@lo:400:kworker.0 Request processed in 27us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230506:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788839737.230517:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788839737.230523:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060756736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230547:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060756736:12345-0@lo:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230552:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788839737.230563:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788839737.230569:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060757248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230599:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875734060757248:12345-0@lo:400:kworker.0 Request processed in 30us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230605:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788839737.230624:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757632 00000100:00100000:2.0:1788839737.230627:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757632 00000100:00100000:2.0:1788839737.230651:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757760 00000100:00100000:2.0:1788839737.230654:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757760 00000100:00100000:2.0:1788839737.230666:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788839737.230672:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060757632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839737.230702:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839737.230733:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060757632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230739:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788839737.230750:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839737.230756:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060757760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839737.230787:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788839737.230815:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060757760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230820:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839737.230839:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756480 00000100:00100000:2.0:1788839737.230842:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756480 00000100:00100000:2.0:1788839737.230865:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756224 00000100:00100000:2.0:1788839737.230868:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756224 00000100:00100000:2.0:1788839737.230878:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788839737.230883:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060756480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230917:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060756480:12345-0@lo:400:kworker.0 Request processed in 34us (7415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230923:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788839737.230934:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788839737.230939:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060756224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.230966:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060756224:12345-0@lo:400:kworker.0 Request processed in 27us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.230972:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788839737.231008:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060756224:0@lo:400:kworker.0 00010000:00080000:2.0:1788839737.231021:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478afb80 x1875734060756736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839737.231037:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060756736:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231038:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788839737.231050:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647bb4e00 x1875734060757248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839737.231058:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060757248:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231064:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060757376:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.231072:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060757760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839737.231082:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060756608:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231088:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.231091:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060757120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.231103:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060757632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839737.231110:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060756480:0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231123:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060758016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839737.231134:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756992 00000100:00100000:2.0:1788839737.231149:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756992 00000100:00100000:1.0:1788839737.231158:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.231171:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757504 00000100:00100000:2.0:1788839737.231175:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757504 00000100:00100000:1.0:1788839737.231180:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060756352:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.231185:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060756864 00000100:00100000:2.0:1788839737.231187:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060756864 00000100:00100000:2.0:1788839737.231196:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757376 00000100:00100000:2.0:1788839737.231198:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757376 00000100:00100000:2.0:1788839737.231210:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788839737.231211:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060755968 00000100:00100000:1.0:1788839737.231214:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060755968 00000100:00100000:2.0:1788839737.231216:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060756992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231240:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1788839737.231246:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060755968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.231249:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060756992:12345-0@lo:400:kworker.0 Request processed in 34us (7717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.231255:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788839737.231266:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788839737.231271:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060757504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231274:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab775074850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060755968:12345-0@lo:400:kworker.0 Request processed in 30us (7823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839737.231280:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788839737.231305:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060757504:12345-0@lo:400:kworker.0 Request processed in 33us (7743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839737.231310:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788839737.231317:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060756864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.231347:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060756864:12345-0@lo:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.232835:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788839737.232877:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788839737.232892:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060757376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839737.232940:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788839737.232965:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060757376:12345-0@lo:400:kworker.0 Request processed in 80us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.232970:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788839737.232987:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758016 00000100:00100000:2.0:1788839737.232994:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758016 00000100:00100000:2.0:1788839737.233029:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839737.233035:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060758016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839737.233049:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788839737.233078:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060758016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.233084:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839737.233372:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060758016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839737.233385:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060756864:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.233395:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060757376:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.233406:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060755968:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.233417:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060756992:0@lo:400:kworker.0 00000100:00100000:2.0:1788839737.235031:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060757504:0@lo:400:kworker.0 00000100:00080000:2.0:1788839737.236355:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839737.236377:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839737.236381:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839737.236383:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839737.239100:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839737.239163:0:10769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060757888 00000100:00100000:3.0:1788839737.239172:0:10769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060757888 00000100:00100000:3.0:1788839737.241609:0:10769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788839737.241623:0:10769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060757888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839737.241652:0:10769:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788839737.241728:0:10769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060757888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839737.241735:0:10769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788839737.249892:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060757888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839737.727925:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060758144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839737.727995:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.728089:0:13777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758144 00000100:00100000:2.0:1788839737.728097:0:13777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758144 00000100:00100000:2.0:1788839737.728144:0:13777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788839737.728154:0:13777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060758144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839737.728187:0:13777:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788839737.728239:0:13777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060758144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.728246:0:13777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788839737.728293:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060758144:0@lo:41:osp-pre-0-1.0 00000020:01000004:1.0:1788839737.920994:0:15121:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788839737.961499:0:15121:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788839737.961629:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.961646:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.961665:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.961672:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.961694:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839737.961699:0:15121:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788839737.961723:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839737.961728:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788839737.961734:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839737.961757:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab7766f3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788839737.961809:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060758272:0@lo:39:umount.0 00000100:00100000:1.0:1788839737.961878:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839737.962010:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839737.962018:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.962026:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839737.962030:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.962039:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839737.962046:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839737.962052:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839737.962061:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788839737.962064:0:6475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788839737.962092:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.962098:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839737.962171:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.962179:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26572b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b92 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.962191:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839737.962193:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839737.962194:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839737.962506:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060758400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839737.962541:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839737.963720:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758400 00000100:00100000:0.0:1788839737.963732:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758400 00000100:00100000:0.0:1788839737.963826:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839737.963839:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+24:3615:x1875734060758400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839737.963855:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839737.963876:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031200/0xad5b343a26572b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b8b expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.963893:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839737.963951:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+23:3615:x1875734060758400:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839737.963958:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839737.963998:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060758400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839737.964099:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758272 00000100:00100000:3.0:1788839737.964103:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758272 00000100:00100000:3.0:1788839737.964144:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788839737.964152:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875734060758272:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788839737.964175:0:7438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265726fa 00000100:00080000:3.0:1788839737.964183:0:7438:0:(import.c:65:import_set_state_nolock()) ffff8ab77e446800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788839737.964242:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3613:x1875734060758272:12345-0@lo:39:umount.0 Request processed in 91us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839737.964249:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788839737.964256:0:7438:0:(genops.c:885:class_export_put()) final put ffff8ab77e443000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788839737.964293:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839737.964370:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e443000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788839737.964627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e446800 for lustre-MDT0000 00000100:00080000:1.0:1788839737.964664:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab7766f3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788839737.964675:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060758272:0@lo:39:umount.0 00000100:00080000:1.0:1788839737.964696:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839737.964699:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788839737.964703:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788839737.968063:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968104:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968112:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968119:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968183:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839737.968190:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968198:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968205:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.968211:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.975246:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839737.975266:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.975300:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839737.975304:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839737.975314:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839737.975321:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839737.975327:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839737.975330:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788839737.975459:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975467:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839737.975498:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975505:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7200/0xad5b343a26572b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572ba0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975526:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839737.975530:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975535:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cbc00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839737.975555:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975563:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839737.975568:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839737.975573:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839737.975575:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788839737.975591:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975596:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839737.975602:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.975610:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839737.975611:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839737.975613:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839737.975819:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060758656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839737.975896:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839737.975953:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839737.975960:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060758528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839737.975982:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.976288:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758656 00000100:00100000:2.0:1788839737.976297:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758656 00000100:00100000:2.0:1788839737.976349:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758528 00000100:00100000:2.0:1788839737.976353:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758528 00000100:00100000:2.0:1788839737.976381:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839737.976390:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+24:3617:x1875734060758656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839737.976402:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839737.976426:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740030e00/0xad5b343a26572aa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572a9d expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.976469:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839737.976498:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788839737.976506:0:15121:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbc00/0xad5b343a26572a9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572aa4 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839737.976507:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+23:3617:x1875734060758656:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.976514:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 10000000:01000000:1.0:1788839737.976518:0:15121:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1788839737.976532:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839737.976538:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+22:3617:x1875734060758528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839737.976542:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839737.976551:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976567:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976573:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976579:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976592:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839737.976597:0:15121:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976604:0:15121:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976610:0:15121:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976616:0:15121:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976625:0:15121:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788839737.976628:0:15121:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788839737.976631:0:15121:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1788839737.976660:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788839737.976665:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976682:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839737.976685:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.976692:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839737.976698:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839737.976704:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788839737.976706:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788839737.976708:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788839737.976724:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839737.976729:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060758656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839737.976730:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839737.976755:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788839737.976866:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060758784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839737.976898:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839737.977207:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839737.977219:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553400/0xad5b343a26572ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b99 expref: 22 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.977232:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839737.977266:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3617:x1875734060758528:12345-0@lo:103:ldlm_bl.0 Request processed in 728us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.977340:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839737.977357:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758784 00000100:00100000:2.0:1788839737.977361:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758784 00000100:00100000:2.0:1788839737.977388:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839737.977395:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+21:3614:x1875734060758784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839737.977403:0:8419:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839737.977422:0:8419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfd600/0xad5b343a26572e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572e01 expref: 21 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.977439:0:8419:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839737.980170:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.980188:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7a00/0xad5b343a26572e01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572e08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839737.980209:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839737.980210:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839737.980213:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788839737.983316:0:15121:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788839737.983325:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788839737.983330:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839737.983335:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788839737.983356:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab646b3a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839737.983362:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab646524800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839737.983366:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab77e7a5800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839737.983370:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab777827800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788839737.983376:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ab647b17800 369e11fa-e360-4215-b9ed-184f44a2087d 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839737.983380:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8ab647a22800 4c22f38d-5944-4459-a83e-bcbd490346fb 192.168.203.52@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1788839737.983385:0:15121:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ab748613370) has exports, disconnecting them 00000020:00080000:1.0:1788839737.983390:0:15121:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab646b3a800), last request at 1788839737 00000020:00000080:1.0:1788839737.983397:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a0a 00000100:00080000:1.0:1788839737.983416:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3e000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788839737.983476:0:15121:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646b3a800): rc 0 00000020:00000080:1.0:1788839737.983478:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab646b3a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788839737.983488:0:15121:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab646524800), last request at 1788839737 00000020:00000080:1.0:1788839737.983492:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265728e4 00000100:00080000:1.0:1788839737.983499:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab646524000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788839737.983509:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839737.983509:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788839737.983546:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b3e000 for lustre-MDT0000 00000020:00080000:1.0:1788839737.983561:0:15121:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646524800): rc 0 00000020:00000080:1.0:1788839737.983563:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab646524800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788839737.983579:0:15121:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab77e7a5800), last request at 1788839502 00000020:00000080:1.0:1788839737.983583:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265727e1 00000100:00080000:1.0:1788839737.983586:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab77e7a7000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788839737.983594:0:15121:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab77e7a5800): rc 0 00000020:00000080:1.0:1788839737.983596:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a5800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788839737.983599:0:15121:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab777827800), last request at 1788839502 00000020:00000080:1.0:1788839737.983609:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265727a9 00000100:00080000:1.0:1788839737.983613:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839737.983620:0:15121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00000080:3.0:1788839737.983628:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646524800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839737.983667:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a5800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788839737.983693:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646524000 for lustre-MDT0000 00000020:00000080:3.0:1788839737.983697:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e7a7000 for lustre-MDT0000 00000020:00080000:1.0:1788839737.983698:0:15121:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab777827800): rc 0 00000004:00000080:1.0:1788839737.983703:0:15121:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb69881bebae0 00010000:00010000:3.0:1788839737.983704:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839737.983721:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839737.983724:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788839737.984273:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060758528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839737.984632:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:096dcd45-3d06-4359-b81b-4bde04036a06+20:3614:x1875734060758784:12345-0@lo:103:ldlm_bl.0 Request processed in 7234us (7730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.984642:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788839737.986831:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839737.986837:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839737.986839:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839737.987674:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788839737.987707:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab777c82800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788839737.988413:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060758912:0@lo:39:umount.0 00000100:00100000:3.0:1788839737.988501:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.989109:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060758912 00000100:00100000:1.0:1788839737.989118:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060758912 00000100:00100000:1.0:1788839737.989181:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788839737.989192:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1875734060758912:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788839737.989230:0:6492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657283c 00000100:00080000:1.0:1788839737.989238:0:6492:0:(import.c:65:import_set_state_nolock()) ffff8ab777b45000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788839737.989271:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1788839737.989356:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839737.989447:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3613:x1875734060758912:12345-0@lo:39:umount.0 Request processed in 256us (945us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788839737.989455:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:3.0:1788839737.989513:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab777c82800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788839737.989521:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060758912:0@lo:39:umount.0 00010000:00010000:2.0:1788839737.989947:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.989960:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839737.989964:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.989975:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839737.989982:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839737.989988:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839737.989991:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788839737.989994:0:6475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788839737.990026:0:6475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.990033:0:6475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839737.990050:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.990057:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741464000/0xad5b343a26572659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572660 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.990071:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839737.990072:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839737.990075:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839737.990128:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060759040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839737.990171:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839737.990383:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759040 00000100:00100000:2.0:1788839737.990390:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759040 00000100:00100000:2.0:1788839737.990453:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839737.990474:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+20:3615:x1875734060759040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839737.990486:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839737.990500:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab741464600/0xad5b343a26572660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572659 expref: 20 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839737.990511:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839737.990554:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:096dcd45-3d06-4359-b81b-4bde04036a06+19:3615:x1875734060759040:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.990561:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839737.990590:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:096dcd45-3d06-4359-b81b-4bde04036a06:3615:1875734060759040:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788839737.990805:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788839737.990809:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788839737.990831:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788839737.990888:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788839737.990914:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab781938800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788839737.990932:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788839737.990935:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788839737.990946:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839737.990949:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060759168:0@lo:9:umount.0 00000100:00100000:3.0:1788839737.990985:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839737.991272:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759168 00000100:00100000:1.0:1788839737.991285:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759168 00000100:00100000:1.0:1788839737.991328:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788839737.991336:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1875734060759168:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788839737.991356:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657298c 00000100:00080000:1.0:1788839737.991363:0:8403:0:(import.c:65:import_set_state_nolock()) ffff8ab78193e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788839737.991401:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788839737.991403:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788839737.991528:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3613:x1875734060759168:12345-0@lo:9:umount.0 Request processed in 193us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839737.991534:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1788839737.991551:0:15121:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788839737.991562:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab646b62800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788839737.991591:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab748613370) has no exports 00000100:00100000:3.0:1788839737.992169:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060759296:0@lo:9:umount.0 00000100:00100000:3.0:1788839737.992206:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839737.992238:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab781938800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788839737.992248:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788839737.992249:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839737.992252:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060759168:0@lo:9:umount.0 00000100:00100000:2.0:1788839737.992594:0:8404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759296 00000100:00100000:2.0:1788839737.992600:0:8404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759296 00000100:00100000:2.0:1788839737.992644:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788839737.992653:0:8404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1875734060759296:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788839737.992671:0:8404:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572ace 00000100:00080000:2.0:1788839737.992677:0:8404:0:(import.c:65:import_set_state_nolock()) ffff8ab646532800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788839737.992718:0:8404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:1.0:1788839737.992813:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839737.992890:0:8404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3613:x1875734060759296:12345-0@lo:9:umount.0 Request processed in 239us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839737.992897:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788839737.992972:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b62800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788839737.992981:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788839737.992983:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788839737.992986:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060759296:0@lo:9:umount.0 00000100:00100000:0.0:1788839737.994727:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060758784:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788839738.006637:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab748613370) has no exports 00000020:00000080:3.0:1788839738.080743:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265726b4 00000020:00000080:3.0:1788839738.080759:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab776697000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788839738.080799:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788839738.082490:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab776697000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788839738.089455:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839738.089472:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788839738.089477:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ab7487d3370) has no exports 00000020:00000080:2.0:1788839738.090457:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265726ad 00000020:00000080:2.0:1788839738.090467:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab776694000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839738.090534:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839738.090554:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788839738.090557:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab75fdf2800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788839738.090574:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab75fdf2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788839738.090583:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788839738.090762:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab776694000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788839738.175688:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839738.758286:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839738.758296:0:8397:0:(genops.c:885:class_export_put()) final put ffff8ab78193c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788839738.758328:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:2.0:1788839738.758331:0:8397:0:(genops.c:885:class_export_put()) final put ffff8ab64816a000/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:1.0:1788839738.759912:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab78193c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788839738.759992:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64816a000/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-OST0000 00000020:00000080:1.0:1788839738.760009:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab78193e800 for lustre-OST0000 00000020:00000080:1.0:1788839738.760014:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64816d800 for lustre-OST0000 00010000:00010000:3.0:1788839739.199936:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788839739.267089:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788839739.267099:0:9483:0:(genops.c:885:class_export_put()) final put ffff8ab646537800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788839739.267241:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788839739.267252:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788839739.267256:0:7420:0:(genops.c:885:class_export_put()) final put ffff8ab777b45800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788839739.267278:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:2.0:1788839739.267281:0:9483:0:(genops.c:885:class_export_put()) final put ffff8ab64809f800/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:3.0:1788839739.268481:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646537800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788839739.268541:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646532800 for lustre-OST0001 00000001:00100000:0.0:1788839739.268857:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00080000:0.0:1788839739.268867:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788839739.268871:0:7420:0:(genops.c:885:class_export_put()) final put ffff8ab777c25000/369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00100000:0.0:1788839739.268877:0:7420:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000001:00080000:0.0:1788839739.268881:0:7420:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788839739.268884:0:7420:0:(genops.c:885:class_export_put()) final put ffff8ab646b39000/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:3.0:1788839739.268945:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b45800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788839739.268994:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777c25000/369e11fa-e360-4215-b9ed-184f44a2087d for lustre-MDT0001 00000020:00000080:3.0:1788839739.269015:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b39000/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-MDT0001 00000020:00000080:3.0:1788839739.269036:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab777b45000 for lustre-MDT0001 00000020:00000080:3.0:1788839739.269040:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab777c24000 for lustre-MDT0001 00000020:00000080:3.0:1788839739.269043:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b3d000 for lustre-MDT0001 00000020:00000080:0.0:1788839739.269544:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab64809f800/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-OST0001 00000020:00000080:0.0:1788839739.269748:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab64809c000 for lustre-OST0001 00000001:00100000:1.0:1788839739.270356:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839739.270362:0:6466:0:(genops.c:885:class_export_put()) final put ffff8ab777827800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788839739.270384:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00080000:1.0:1788839739.270391:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788839739.270401:0:6466:0:(genops.c:885:class_export_put()) final put ffff8ab647b17800/369e11fa-e360-4215-b9ed-184f44a2087d 00000001:00100000:1.0:1788839739.270408:0:6466:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4c22f38d-5944-4459-a83e-bcbd490346fb 00000001:00080000:1.0:1788839739.270412:0:6466:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788839739.270430:0:6466:0:(genops.c:885:class_export_put()) final put ffff8ab647a22800/4c22f38d-5944-4459-a83e-bcbd490346fb 00000020:00000080:0.0:1788839739.270483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777827800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788839739.271732:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647b17800/369e11fa-e360-4215-b9ed-184f44a2087d for lustre-MDT0000 00000020:00000080:0.0:1788839739.271764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a22800/4c22f38d-5944-4459-a83e-bcbd490346fb for lustre-MDT0000 00000020:00000080:0.0:1788839739.271808:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e6bd000 for lustre-MDT0000 00000020:00000080:0.0:1788839739.271812:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647b12800 for lustre-MDT0000 00000020:00000080:0.0:1788839739.271816:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab647a25800 for lustre-MDT0000 00000020:01000000:1.0:1788839740.095755:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6474427e0 - data ffff8ab75f3586c0/ffff8ab647568000 00000020:01000000:1.0:1788839740.095966:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab75e765720 - data ffff8ab75f1860d8/ffff8ab77e481c00 00000001:00000004:1.0:1788839740.102454:0:15121:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1788839740.146918:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788839740.146929:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788839740.146942:0:15121:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8ab647bb7b80 x1875734060758912/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788839747 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839740.146966:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788839740.148279:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839740.148285:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788839740.148303:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839740.148305:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839740.148600:0:8530:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839740.148604:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788839740.148614:0:8530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788839740.149241:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839740.149245:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788839740.149269:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839740.149271:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788839740.152303:0:9814:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788839740.152311:0:9814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788839740.152323:0:9814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788839740.153735:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657267c 00000020:00000080:0.0:1788839740.153745:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab744394800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788839740.153826:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744394800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788839740.156173:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572691 00000020:00000080:0.0:1788839740.156188:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab74e563800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788839740.156215:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788839740.156219:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.156227:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839740.156236:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ab748610000) has no exports 00000020:00000080:3.0:1788839740.156310:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74e563800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1788839740.156521:0:15121:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788839740.156529:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572ac7 00000020:00000080:0.0:1788839740.156533:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab647a23800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788839740.156549:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788839740.156552:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.156561:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839740.156564:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8ab6479e99b8) has no exports 00000020:00000080:0.0:1788839740.156570:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572ac0 00000020:00000080:0.0:1788839740.156575:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab646b67800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788839740.156625:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab647a23800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788839740.156631:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b67800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788839740.157014:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788839740.157018:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839740.157022:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788839740.157028:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839740.157030:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839740.157094:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.157103:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788839740.157108:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572985 00000020:00000080:0.0:1788839740.157113:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab78193c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839740.157537:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b62800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788839740.157545:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab6475ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839740.157548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6475ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788839740.157553:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788839740.160067:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788839740.160081:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.160095:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839740.160101:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8ab646693370) has no exports 00000020:00000080:0.0:1788839740.160110:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657297e 00000020:00000080:0.0:1788839740.160118:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab744396000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788839740.160408:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab78193c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788839740.160425:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744396000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788839740.160643:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788839740.160648:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839740.160652:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788839740.160657:0:15121:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839740.160659:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839740.160722:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.160731:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788839740.160744:0:15121:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788839740.160750:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572835 00000020:00000080:0.0:1788839740.160755:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab777b44800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839740.160888:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab781938800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788839740.160896:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab641af6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839740.160898:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788839740.160935:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788839740.161077:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788839740.161087:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.161091:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839740.161095:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ab77e793370) has no exports 00000020:00000080:0.0:1788839740.161099:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657282e 00000020:00000080:0.0:1788839740.161103:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab777c86000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788839740.163298:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b44800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788839740.165283:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777c86000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788839740.186643:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788839740.186653:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788839740.186658:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788839740.186668:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839740.186727:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.186740:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788839740.186766:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.186793:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788839740.186799:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab744391000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788839740.186804:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744391000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788839740.186816:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788839740.186913:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572698 00000020:00000080:0.0:1788839740.186921:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab74e567000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788839740.186927:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788839740.186931:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.186935:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839740.186939:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ab7486119b8) has no exports 00000020:00000080:0.0:1788839740.186957:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.186961:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788839740.186965:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657269f 00000020:00000080:0.0:1788839740.186968:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab74e565800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788839740.186976:0:15121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab745341000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788839740.186980:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab745341000 3 00000020:01000004:0.0:1788839740.186983:0:15121:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab745341000 from lustre-MDT0000 00000020:00000080:0.0:1788839740.187000:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.187003:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788839740.187006:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab744396800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788839740.187018:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744396800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788839740.187026:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788839740.187057:0:15121:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788839740.187062:0:15121:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788839740.187065:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788839740.187067:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.187069:0:15121:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788839740.187076:0:15121:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ab778be8000 096dcd45-3d06-4359-b81b-4bde04036a06 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788839740.187081:0:15121:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ab7487d0000) has exports, disconnecting them 00000020:00080000:0.0:1788839740.187085:0:15121:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ab778be8000), last request at 1788839477 00000020:00000080:0.0:1788839740.187099:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657263d 00000020:00010000:0.0:1788839740.187102:0:15121:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab778be8000: total 2 00000100:00080000:0.0:1788839740.187107:0:15121:0:(import.c:65:import_set_state_nolock()) ffff8ab778bee800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788839740.187125:0:15121:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab778be8000): rc 0 00000020:00080000:0.0:1788839740.187129:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ab7487d0000) has no exports 00000100:00100000:0.0:1788839740.187184:0:6480:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ab745d67000:6480] 1 exiting: rc = 0 00000100:00100000:0.0:1788839740.187278:0:6481:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ab745d66000:6481] 2 exiting: rc = 0 00000020:00000080:3.0:1788839740.187392:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab777c82800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788839740.187411:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788839740.187421:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788839740.187428:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839740.187485:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74e567000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788839740.187490:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab744397800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788839740.187492:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744397800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788839740.187495:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788839740.187522:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74e565800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788839740.187656:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab778be8000: total 0 00010000:00010000:2.0:1788839740.187697:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab778be8000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788839740.187730:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552200/0xad5b343a26572b84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b7d expref: 14 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187748:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de6400/0xad5b343a26572b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b61 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187760:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031a00/0xad5b343a26572b76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b6f expref: 12 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187799:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfdc00/0xad5b343a26572dde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572dd7 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187810:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab740031800/0xad5b343a26572739 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572732 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187840:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab782079400/0xad5b343a26572747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572740 expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187853:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552e00/0xad5b343a26572bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572ba7 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187864:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552600/0xad5b343a26572b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b37 expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187874:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab7413ca600/0xad5b343a26572dec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572de5 expref: 6 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187885:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647958800/0xad5b343a26572dfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572df3 expref: 5 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187897:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab777de7600/0xad5b343a26572a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572a57 expref: 4 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187908:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842800/0xad5b343a26572b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b53 expref: 3 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187917:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552400/0xad5b343a26572b4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xad5b343a26572b45 expref: 2 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839740.187927:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab778be8000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788839740.187944:0:6476:0:(genops.c:885:class_export_put()) final put ffff8ab778be8000/096dcd45-3d06-4359-b81b-4bde04036a06 00010000:00010000:2.0:1788839740.187959:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839740.187962:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839740.187963:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839740.188003:0:6479:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ab75f6a5a00:6479] 0 exiting: rc = 1 00000020:00000080:0.0:1788839740.188132:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab778be8000/096dcd45-3d06-4359-b81b-4bde04036a06 for MGS 00000020:00000080:0.0:1788839740.188162:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab778bee800 for MGS 00000100:00100000:0.0:1788839740.188194:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188202:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188207:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188213:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188219:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188224:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188229:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188235:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188240:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188247:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188252:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188258:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188264:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188277:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188282:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188286:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188291:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188296:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188304:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188310:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188316:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188322:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188328:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188334:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188340:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188346:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188352:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188358:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188364:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188369:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188375:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188380:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188386:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188392:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188396:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188507:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188513:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188519:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188524:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188529:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188535:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188540:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188544:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188550:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188555:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188560:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188565:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188571:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188583:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188589:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188594:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188600:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188606:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188611:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188617:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188622:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188628:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188633:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188638:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188643:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188648:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188654:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188660:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839740.188665:0:15121:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788839740.189841:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab646625480 - data ffff8ab75f165000/ffff8ab777d39800 00000020:01000000:0.0:1788839740.189948:0:15121:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab7487c5d80 - data ffff8ab75f02b870/ffff8ab75e5b8400 00000020:00000080:0.0:1788839740.190499:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572621 00000020:00000080:0.0:1788839740.190508:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab7487d8800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788839740.190528:0:15121:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab745341000 from MGS, refs=2 00000020:01000004:0.0:1788839740.190532:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab745341000 2 00000020:01000004:0.0:1788839740.190535:0:15121:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab745341000 from MGS 00000020:00000080:0.0:1788839740.190555:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839740.190561:0:15121:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788839740.190563:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab7487da800/MGS 00000020:00000080:0.0:1788839740.190566:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487da800/MGS for MGS 00000020:01000000:0.0:1788839740.190573:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788839740.190633:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788839740.190637:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839740.190642:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788839740.190649:0:15121:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ab7766f5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788839740.190654:0:15121:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8ab7487d19b8) has exports, disconnecting them 00000020:00080000:0.0:1788839740.190668:0:15121:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ab7766f5000), last request at 1788839477 00000020:00000080:0.0:1788839740.190673:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265726ec 00000020:00080000:0.0:1788839740.190682:0:15121:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab7766f5000): rc 0 00000020:00000080:0.0:1788839740.190687:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab7766f5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788839740.191329:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487d8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788839740.191338:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7766f5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788839740.216846:0:15121:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788839740.216857:0:15121:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839740.216863:0:15121:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839740.216871:0:15121:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839740.217093:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839740.217101:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788839740.217108:0:15121:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab745341000 1 00000020:00000080:2.0:1788839740.217114:0:15121:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572613 00000020:00000080:2.0:1788839740.217122:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab7487da000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788839740.217128:0:15121:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788839740.217135:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839740.217138:0:15121:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788839740.217142:0:15121:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ab748614d28) has no exports 00000020:00000080:3.0:1788839740.217169:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab7766f3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788839740.217180:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab7766f3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788839740.217184:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7766f3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788839740.217196:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788839740.217286:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7487da000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:2.0:1788839740.286666:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788839740.324094:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839740.324121:0:15121:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788839740.324127:0:15121:0:(genops.c:885:class_export_put()) final put ffff8ab745347000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788839740.324132:0:15121:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab745347000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788839740.324138:0:15121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788839740.324256:0:15121:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab745347800 00000020:02000400:2.0:1788839740.324319:0:15121:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788839741.331646:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839742.335500:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060759424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839742.335587:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839742.335623:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759424 00000100:00100000:2.0:1788839742.335631:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759424 00000100:00100000:2.0:1788839742.335702:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788839742.335714:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060759424:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788839742.335738:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000024:2.0:1788839742.335746:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788839742.335748:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839742.335759:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060759552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839742.335809:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839742.336559:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759552 00000100:00100000:0.0:1788839742.336565:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759552 00000100:00100000:0.0:1788839742.336598:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788839742.336608:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060759552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839742.336632:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788839742.336688:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060759552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839742.336696:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788839742.336830:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060759552:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788839742.336981:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839742.336985:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839742.338376:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060759680:0@lo:400:kworker.0 00000100:00100000:3.0:1788839742.338389:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060759808:0@lo:400:kworker.0 00000400:00000100:1.0:1788839742.338441:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060759680 offset 0 length 224: 4 00000100:00100000:0.0:1788839742.338533:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060759936:0@lo:400:kworker.0 00000100:00100000:3.0:1788839742.342511:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839742.342725:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060760320:0@lo:400:kworker.0 00000100:00100000:3.0:1788839742.342801:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839742.350285:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060760064:0@lo:400:kworker.0 00000100:00100000:1.0:1788839742.350624:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839742.350690:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759808 00000100:00100000:1.0:1788839742.350699:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759808 00000100:00100000:1.0:1788839742.350745:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788839742.350752:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875734060759808:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788839742.350761:0:6493:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788839742.350824:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1875734060759808:12345-0@lo:400:kworker.0 Request processed in 71us (8325us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839742.350832:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788839742.350855:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760320 00000100:00100000:1.0:1788839742.350859:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760320 00000100:00100000:1.0:1788839742.350888:0:12241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760064 00000100:00100000:1.0:1788839742.350890:0:12241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760064 00000100:00100000:1.0:1788839742.350907:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788839742.350912:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875734060760320:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788839742.350918:0:12241:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788839742.350957:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3615:x1875734060760320:12345-0@lo:400:kworker.0 Request processed in 43us (8155us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839742.350963:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788839742.350976:0:12241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788839742.350980:0:12241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875734060760064:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788839742.350984:0:12241:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788839742.351011:0:12241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3617:x1875734060760064:12345-0@lo:400:kworker.0 Request processed in 29us (388us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839742.351016:0:12241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:1.0:1788839742.351053:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839742.351057:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bc000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788839742.351061:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788839742.354689:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839742.354743:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060759936 00000100:00100000:0.0:1788839742.354752:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060759936 00000100:00100000:0.0:1788839742.354818:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788839742.354828:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875734060759936:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788839742.354838:0:6487:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788839742.354897:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875734060759936:12345-0@lo:400:kworker.0 Request processed in 70us (215us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788839742.354905:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1788839742.354963:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788839742.354969:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8ab77e537800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788839742.354973:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788839742.354980:0:3616:0:(import.c:65:import_set_state_nolock()) ffff8ab77e537800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839742.354984:0:3616:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 157 00000100:00080000:0.0:1788839742.354991:0:3616:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ab77e537800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839742.355021:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777ca8380 x1875734060760576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839742.355046:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060759936:0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.355058:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060760448:0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.355092:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839742.355113:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760448 00000100:00100000:0.0:1788839742.355117:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760448 00000100:00100000:0.0:1788839742.355151:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788839742.355160:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060760448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.355206:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060760448:12345-0@lo:400:kworker.0 Request processed in 49us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839742.355214:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1788839742.355233:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788839742.355257:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ab781a4a300 x1875734060760448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839742.355270:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060760448:0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.355306:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060759424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839742.360711:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060759424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 24990us (25114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839742.360737:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788839742.368140:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060760192:0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.368213:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839742.368257:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760192 00000100:00100000:0.0:1788839742.368264:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760192 00000100:00100000:0.0:1788839742.371490:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788839742.371510:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060760192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.371599:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060760192:12345-0@lo:400:kworker.0 Request processed in 98us (3386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839742.371607:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00080000:0.0:1788839742.371639:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788839742.371698:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8ab781a4ad80 x1875734060760192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839742.371714:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060760192:0@lo:400:kworker.0 00000100:00080000:0.0:1788839742.371812:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788839742.371818:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788839742.371822:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788839742.371827:0:3617:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839742.371831:0:3617:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 180 00000100:00080000:0.0:1788839742.371837:0:3617:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab77e444000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839742.371864:0:3617:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777ca9180 x1875734060760704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839742.371888:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060760064:0@lo:400:kworker.0 00000100:00100000:0.0:1788839742.371931:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060760576:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788839742.371969:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839742.371988:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060760704:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788839742.372006:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839742.372032:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760576 00000100:00100000:0.0:1788839742.372037:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760576 00000100:00100000:0.0:1788839742.372055:0:7438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760704 00000100:00100000:0.0:1788839742.372058:0:7438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760704 00000100:00100000:0.0:1788839742.372073:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839742.372079:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060760576:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1788839742.372097:0:7438:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788839742.372135:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060760576:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 55us (165us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788839742.372142:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788839742.372155:0:7438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788839742.372160:0:7438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060760704:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1788839742.372170:0:7438:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788839742.372194:0:7438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3613:x1875734060760704:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 33us (187us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788839742.372199:0:7438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788839742.372224:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e537800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839742.372228:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788839742.372231:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060760576:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788839742.372238:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839742.372241:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788839742.372251:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060760704:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788839742.383305:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839742.383317:0:3615:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 156 00000100:00080000:1.0:1788839742.383326:0:3615:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ab77e6bc000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839742.383363:0:3615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab647bb7b80 x1875734060760832/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839742.383413:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060759808:0@lo:400:kworker.0 00000100:00080000:1.0:1788839742.383444:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839742.383448:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ab000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788839742.383451:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788839742.383456:0:3615:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788839742.383459:0:3615:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 201 00000100:00080000:1.0:1788839742.383464:0:3615:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ab000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839742.383487:0:3615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab647bb4a80 x1875734060760960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788839742.383499:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060760320:0@lo:400:kworker.0 00000100:00100000:3.0:1788839742.384121:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060760832:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788839742.384191:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839742.384228:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060760960:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788839742.384252:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839742.384497:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760832 00000100:00100000:1.0:1788839742.384505:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760832 00000100:00100000:1.0:1788839742.384565:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788839742.384573:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060760832:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788839742.384601:0:6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788839742.384650:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060760832:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 76us (458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788839742.384658:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1788839742.384689:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839742.384694:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788839742.384697:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060760832:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788839742.388731:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060760960 00000100:00100000:2.0:1788839742.388747:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060760960 00000100:00100000:2.0:1788839742.390291:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788839742.390308:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060760960:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788839742.390333:0:6488:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788839742.390430:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060760960:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 125us (6175us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788839742.395323:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:2.0:1788839742.395418:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839742.395425:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788839742.395430:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060760960:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1788839743.360474:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788839744.187100:0:15324:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000040:00080000:1.0:1788839744.202191:0:13769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:2.0:1788839744.202487:0:15324:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788839744.202655:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.202667:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.202674:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.202680:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.202704:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788839744.202720:0:15324:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788839744.202739:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839744.202743:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788839744.202750:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788839744.202755:0:15324:0:(import.c:65:import_set_state_nolock()) ffff8ab77e537800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788839744.202760:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839744.202761:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788839744.202764:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788839744.203147:0:15122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839744.203155:0:15122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839744.203162:0:15122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839744.203165:0:15122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839744.203173:0:15122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839744.203179:0:15122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839744.203192:0:15122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788839744.203194:0:15122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788839744.203196:0:15122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788839744.203227:0:15122:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839744.203233:0:15122:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788839744.203262:0:15122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839744.203268:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de7000/0xad5b343a26572b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b76 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839744.203280:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839744.203281:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839744.203283:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839744.203291:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788839744.203308:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060761088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788839744.203366:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839744.204251:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204264:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204270:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204276:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204295:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839744.204300:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204306:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204311:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204329:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204338:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839744.204343:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204349:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204354:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204359:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.204369:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1788839744.204633:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761088 00000100:00100000:1.0:1788839744.204640:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761088 00000100:00100000:1.0:1788839744.204682:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788839744.204690:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3616:x1875734060761088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788839744.204697:0:6472:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839744 with bad export cookie 12491635415798195773 00010000:00010000:0.0:1788839744.205793:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788839744.205805:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205815:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839744.205818:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205829:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839744.205836:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839744.205842:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839744.205844:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788839744.205890:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205897:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839744.205926:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205933:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647842400/0xad5b343a26572b7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572b84 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205946:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839744.205950:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205970:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cbe00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839744.205973:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.205979:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839744.205985:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839744.205990:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839744.205993:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788839744.206038:0:15324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.206047:0:15324:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.206054:0:15324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.206062:0:15324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839744.206083:0:15324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788839744.208406:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788839744.208457:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.208478:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839744.208494:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.209896:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cbe00/0xad5b343a26572a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572a5e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.209921:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839744.209927:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.209934:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839744.209938:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.209963:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839744.209970:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839744.209977:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788839744.209979:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788839744.209984:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788839744.210019:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210026:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839744.210050:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210057:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647959800/0xad5b343a26572df3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572dfa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210066:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839744.210070:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210075:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab741464800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839744.210078:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210085:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839744.210102:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839744.210106:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839744.210108:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788839744.210110:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788839744.210123:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210127:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839744.210133:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210138:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741464800/0xad5b343a26572740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xad5b343a26572747 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839744.210150:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839744.210151:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839744.210154:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839744.210162:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839744.210183:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060761216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839744.210252:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839744.210303:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839744.210309:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060761344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839744.210332:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839744.210357:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060761600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839744.212145:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839744.212207:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839744.212232:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060761472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839744.212273:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839744.212310:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761216 00000100:00100000:0.0:1788839744.212321:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761216 00000100:00100000:0.0:1788839744.212355:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761344 00000100:00100000:0.0:1788839744.212358:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761344 00000100:00100000:0.0:1788839744.212369:0:8419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761600 00000100:00100000:3.0:1788839744.212598:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761472 00000100:00100000:3.0:1788839744.212603:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761472 00000100:00100000:3.0:1788839744.212625:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839744.212633:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3614:x1875734060761216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788839744.212641:0:6473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839744 with bad export cookie 12491635415798195773 00000100:00100000:3.0:1788839744.212703:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3614:x1875734060761216:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (2449us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788839744.212711:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788839744.212731:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839744.212735:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3614:x1875734060761344:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788839744.212739:0:6473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839744 with bad export cookie 12491635415798195773 00000100:00100000:3.0:1788839744.212766:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3614:x1875734060761344:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (2433us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788839744.212788:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839744.212802:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839744.212806:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3617:x1875734060761472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788839744.212810:0:6473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839744 with bad export cookie 12491635415798195773 00000100:00100000:3.0:1788839744.212843:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3617:x1875734060761472:12345-0@lo:103:ldlm_bl.0 Request processed in 35us (570us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788839744.212849:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839744.215796:0:8419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761600 00000100:00100000:0.0:1788839744.215863:0:8419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839744.215870:0:8419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3617:x1875734060761600:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788839744.215877:0:8419:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788839744 with bad export cookie 12491635415798195773 00000100:00100000:0.0:1788839744.215965:0:8419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3617:x1875734060761600:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (3824us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788839744.215972:0:8419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788839744.216020:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788839744.216024:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788839744.216027:0:3614:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 10000000:01000000:2.0:1788839744.216597:0:15324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788839744.216603:0:15324:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788839744.216985:0:15324:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788839744.216989:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788839744.216993:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839744.216998:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788839744.217004:0:15324:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ab646b38800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788839744.217010:0:15324:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8ab646521000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788839744.217014:0:15324:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8ab7486ecd28) has exports, disconnecting them 00000020:00080000:2.0:1788839744.217018:0:15324:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ab646b38800), last request at 1788839742 00000020:00000080:2.0:1788839744.217024:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a1f 00000100:00080000:2.0:1788839744.217035:0:15324:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788839744.217071:0:15324:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646b38800): rc 0 00000020:00000080:2.0:1788839744.217073:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab646b38800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788839744.217078:0:15324:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8ab646521000), last request at 1788839742 00000020:00000080:2.0:1788839744.217080:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265728f9 00000100:00080000:2.0:1788839744.217086:0:15324:0:(import.c:65:import_set_state_nolock()) ffff8ab646521800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788839744.217093:0:15324:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646521000): rc 0 00000020:00000080:2.0:1788839744.217095:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab646521000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788839744.217102:0:15324:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb69881c23ae0 00000100:00080000:2.0:1788839744.217119:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839744.217122:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788839744.217874:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788839744.217880:0:15324:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bc000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:3.0:1788839744.218043:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b38800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788839744.218086:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646521000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788839744.218107:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b3b800 for lustre-MDT0001 00000020:00000080:3.0:1788839744.218111:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646521800 for lustre-MDT0001 00010000:00010000:1.0:1788839744.220761:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839744.220914:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3616:x1875734060761088:12345-0@lo:103:ldlm_bl.0 Request processed in 16220us (17542us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788839744.220925:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788839744.221076:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839744.221082:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839744.221113:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788839744.221550:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788839744.221700:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788839744.221705:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788839744.221718:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788839744.221791:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788839744.221810:0:15324:0:(import.c:65:import_set_state_nolock()) ffff8ab641af3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788839744.221826:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788839744.221828:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1788839744.221836:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788839744.221890:0:15324:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788839744.221896:0:15324:0:(import.c:65:import_set_state_nolock()) ffff8ab78193f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788839744.221918:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ab7486ecd28) has no exports 00000100:00100000:3.0:1788839744.237991:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060761728:0@lo:9:umount.0 00000100:00100000:3.0:1788839744.238084:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839744.238127:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060761856:0@lo:9:umount.0 00000100:00100000:3.0:1788839744.238149:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839744.238195:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761728 00000100:00100000:3.0:1788839744.238203:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761728 00000100:00100000:3.0:1788839744.238268:0:8538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060761856 00000100:00100000:3.0:1788839744.238271:0:8538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060761856 00000100:00100000:3.0:1788839744.238303:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839744.238312:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1875734060761728:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788839744.238344:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572946 00000100:00080000:3.0:1788839744.238354:0:8538:0:(import.c:65:import_set_state_nolock()) ffff8ab742bed800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839744.238410:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788839744.238746:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3613:x1875734060761728:12345-0@lo:9:umount.0 Request processed in 433us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839744.238754:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839744.238805:0:8538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839744.238813:0:8538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1875734060761856:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788839744.238825:0:8538:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a8f 00000100:00080000:3.0:1788839744.238831:0:8538:0:(import.c:65:import_set_state_nolock()) ffff8ab646b38000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788839744.238873:0:8538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788839744.239084:0:8538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3613:x1875734060761856:12345-0@lo:9:umount.0 Request processed in 271us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839744.239090:0:8538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788839744.239145:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab641af3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788839744.239157:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788839744.239159:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839744.239162:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060761728:0@lo:9:umount.0 00000100:00080000:3.0:1788839744.239173:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab78193f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788839744.239176:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788839744.239178:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788839744.239180:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060761856:0@lo:9:umount.0 00000100:00080000:0.0:1788839744.241205:0:3614:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788839744.241211:0:3614:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788839744.241219:0:3614:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab781a4a680 x1875734060759680/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788839758 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839744.241231:0:3614:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab647bb7b80 x1875734060761088/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839760 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839744.241240:0:3614:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab777ca9180 x1875734060761216/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839760 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839744.241249:0:3614:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab777ca8380 x1875734060761344/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839760 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839744.241256:0:3614:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab777ca9f80 x1875734060761600/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839760 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839744.241281:0:3614:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab777ca8a80 x1875734060761472/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788839760 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788839744.241290:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788839744.241292:0:3614:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788839744.241293:0:3614:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788839744.241412:0:3617:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ab744672800 already not connected (conn 1, was 1): DISCONN 00010000:00010000:2.0:1788839744.241430:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839744.241450:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060761600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839744.241486:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:096dcd45-3d06-4359-b81b-4bde04036a06:3617:1875734060761472:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788839744.241641:0:3616:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8ab744672800 already not connected (conn 1, was 1): DISCONN 00010000:00010000:1.0:1788839744.241796:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839744.241817:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:096dcd45-3d06-4359-b81b-4bde04036a06:3616:1875734060761088:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788839744.244162:0:3614:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839744.244177:0:3614:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 132 00000100:00080000:0.0:1788839744.244187:0:3614:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab744672800 using connection 192.168.203.152@tcp/0@lo 00000100:00080000:0.0:1788839744.244206:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788839744.244211:0:6482:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839744.245307:0:3614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777cab800 x1875734060761984/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839744.245357:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060761216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839744.245367:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060759680:0@lo:400:kworker.0 00000100:00100000:0.0:1788839744.245419:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:096dcd45-3d06-4359-b81b-4bde04036a06:3614:1875734060761344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839744.245427:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060761984:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788839744.245484:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060761984 offset 0 length 520: 4 00000020:00080000:3.0:1788839744.255253:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ab7486ecd28) has no exports 00000020:01000000:0.0:1788839744.317761:0:15324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab6466259c0 - data ffff8ab75f33d870/ffff8ab777d38000 00000020:01000000:0.0:1788839744.317928:0:15324:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab7483c08a0 - data ffff8ab75f182360/ffff8ab777855000 00000001:00000004:0.0:1788839744.338075:0:15324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00010000:00010000:0.0:1788839744.384399:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788839744.404486:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788839744.404498:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788839744.404507:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788839744.406152:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839744.406158:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788839744.406239:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839744.406242:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839744.407070:0:8523:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839744.407076:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:2.0:1788839744.407088:0:8523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788839744.407672:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839744.407677:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1788839744.407700:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839744.407702:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788839744.408932:0:9810:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788839744.408938:0:9810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1788839744.408948:0:9810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788839744.410674:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572763 00000020:00000080:0.0:1788839744.410687:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e5ce800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788839744.411093:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e5ce800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788839744.420348:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572778 00000020:00000080:0.0:1788839744.420365:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788839744.420404:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788839744.420409:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839744.420417:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839744.420422:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ab7486e99b8) has no exports 00000004:01000000:0.0:1788839744.420597:0:15324:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788839744.420605:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a81 00000020:00000080:0.0:1788839744.420610:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab6475aa800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788839744.420615:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788839744.420618:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839744.420625:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839744.420627:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8ab6479a0000) has no exports 00000020:00000080:0.0:1788839744.420633:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a7a 00000020:00000080:0.0:1788839744.420636:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab78193a800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788839744.421200:0:15324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788839744.421205:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788839744.421209:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788839744.421215:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839744.421218:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839744.421248:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839744.421258:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788839744.421263:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657293f 00000020:00000080:0.0:1788839744.421267:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab641af0000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:0.0:1788839744.421271:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788839744.421284:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839744.421288:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788839744.421291:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8ab646690000) has no exports 00000020:00000080:0.0:1788839744.421294:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572938 00000020:00000080:0.0:1788839744.421297:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab641af0800/lustre-MDT0001-osd_UUID 00010000:01000000:0.0:1788839744.422343:0:15324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788839744.422348:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788839744.422351:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788839744.422358:0:15324:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788839744.422360:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839744.422649:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:1.0:1788839744.422666:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab6475aa800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788839744.422671:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab78193a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788839744.422677:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab78193f800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788839744.422686:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab646b65000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839744.422688:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b65000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788839744.422691:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839744.422765:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af0000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788839744.422785:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af0800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788839744.422789:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab641af3800 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788839744.423978:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839744.423992:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788839744.423998:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab641af3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788839744.424001:0:15324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af3000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788839744.424007:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788839744.424090:0:15324:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788839744.424098:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657279b 00000020:00000080:0.0:1788839744.424105:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839744.426312:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a1000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1788839744.428694:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788839744.428751:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839744.428764:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839744.428784:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ab77e4fcd28) has no exports 00000020:00000080:0.0:1788839744.428795:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572794 00000020:00000080:0.0:1788839744.428805:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e6bc800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788839744.428844:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e6bc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788839744.430835:0:15324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788839744.430842:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839744.430846:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788839744.430854:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839744.430882:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e6bc000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788839744.430951:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839744.430961:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839744.430966:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e6ba000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839744.430970:0:15324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e6ba000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788839744.430975:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839744.431567:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839744.431573:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839744.431576:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e5ca000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788839744.431578:0:15324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e5ca000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788839744.431583:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788839744.431684:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657277f 00000020:00000080:1.0:1788839744.431691:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a5000/lustre-MDD0001_UUID 00000020:01000000:1.0:1788839744.431760:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788839744.431765:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839744.431787:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788839744.431792:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8ab77e790000) has no exports 00000020:00000080:1.0:1788839744.431819:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839744.431823:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788839744.431827:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572786 00000020:00000080:1.0:1788839744.431831:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a3000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788839744.433493:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a5000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1788839744.433503:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab7479db800/lustre-MDD0001_UUID 00000020:00000080:2.0:1788839744.433505:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab7479db800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1788839744.433522:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:1.0:1788839744.434019:0:15324:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab74434b000 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788839744.434025:0:15324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab74434b000 2 00000020:01000004:1.0:1788839744.434027:0:15324:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab74434b000 from lustre-MDT0001 00000020:00000080:1.0:1788839744.434109:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839744.434117:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788839744.434121:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e5c8000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788839744.434123:0:15324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e5c8000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788839744.434130:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788839744.434308:0:15324:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788839744.434312:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788839744.434316:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839744.434321:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788839744.434328:0:15324:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8ab760d8b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788839744.434334:0:15324:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8ab7487d4d28) has exports, disconnecting them 00000020:00080000:1.0:1788839744.434340:0:15324:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8ab760d8b000), last request at 1788839502 00000020:00000080:1.0:1788839744.434345:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265727da 00000020:00080000:1.0:1788839744.434371:0:15324:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab760d8b000): rc 0 00000020:00000080:1.0:1788839744.434375:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab760d8b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788839744.435197:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a3000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788839744.435208:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab760d8b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788839744.455658:0:15324:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788839744.455668:0:15324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839744.455672:0:15324:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788839744.455679:0:15324:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839744.455875:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839744.455883:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788839744.455891:0:15324:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab74434b000 1 00000020:00000080:1.0:1788839744.455897:0:15324:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572716 00000020:00000080:1.0:1788839744.455906:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab77e536800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788839744.455911:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788839744.455918:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839744.455922:0:15324:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788839744.455925:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ab77e4f99b8) has no exports 00000020:00000080:2.0:1788839744.459192:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e537800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788839744.459209:0:8:0:(genops.c:885:class_export_put()) final put ffff8ab77e532000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788839744.459213:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e532000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788839744.459228:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788839744.460555:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e536800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788839744.601799:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839744.601812:0:15324:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788839744.601818:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab74434f800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788839744.601822:0:15324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab74434f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788839744.601832:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788839744.601941:0:15324:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab744349000 00000020:01000000:0.0:1788839744.601970:0:15324:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788839744.601981:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839744.601985:0:15324:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788839744.601989:0:15324:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ab7486eb370) has no exports 00000100:00100000:0.0:1788839744.602075:0:6487:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ab74861f400:6487] 0 exiting: rc = 1 00000100:00100000:0.0:1788839744.602184:0:6489:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ab743649400:6489] 2 exiting: rc = 0 00000100:00100000:3.0:1788839744.602338:0:12241:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8ab6476a2200:12241] 4 exiting: rc = 0 00000100:00100000:3.0:1788839744.602408:0:6488:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ab74861f000:6488] 1 exiting: rc = 0 00000100:00100000:1.0:1788839744.602514:0:7438:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ab777819200:7438] 3 exiting: rc = 0 00000100:00100000:0.0:1788839744.602685:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602695:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602701:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602708:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602714:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602720:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602725:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602729:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602735:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602741:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602746:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602751:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602757:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602762:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602767:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602981:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602986:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602992:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.602997:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603003:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603008:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603014:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603019:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603024:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603028:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603033:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603038:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603043:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603048:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603053:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603067:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603072:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603078:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603084:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603090:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603096:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603101:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603106:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603111:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603116:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603121:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603126:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603131:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603136:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603141:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603147:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603152:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603168:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603174:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603179:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603184:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603190:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603194:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603199:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603205:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603210:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603216:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603221:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603226:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603232:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603236:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603241:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603246:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.603252:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618180:0:6491:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ab775022000:6491] 1 exiting: rc = 0 00000100:00100000:3.0:1788839744.618312:0:6490:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ab775022400:6490] 0 exiting: rc = 1 00000100:00100000:3.0:1788839744.618371:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618379:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618396:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618404:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618411:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618416:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618423:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618428:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618434:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618440:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618461:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618467:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618473:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618478:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618483:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618488:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618493:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618498:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618514:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618520:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618525:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618530:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618536:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618541:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618546:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618551:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618557:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618562:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.618566:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619554:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619564:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619576:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619583:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619588:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619593:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619598:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619604:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619609:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619614:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619619:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619624:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619629:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619634:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619639:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619645:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619660:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619666:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619671:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619677:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619682:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619689:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619694:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619700:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619705:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619710:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619715:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619720:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619725:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619729:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619734:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619739:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619745:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619750:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.619760:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620261:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ab744629600:6493] 1 exiting: rc = 0 00000100:00100000:3.0:1788839744.620365:0:6492:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ab744629000:6492] 0 exiting: rc = 1 00000100:00100000:3.0:1788839744.620437:0:13777:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8ab6480afc00:13777] 2 exiting: rc = 0 00000100:00100000:3.0:1788839744.620481:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620488:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620501:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620507:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620513:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620518:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620524:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620530:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620535:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620541:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620547:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620552:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620557:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620570:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620589:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620595:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620601:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620607:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620613:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620619:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620625:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620631:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620636:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620641:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620647:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620652:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620672:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620679:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620684:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620690:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620696:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620701:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620707:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620714:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620719:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620725:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620731:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.620736:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622706:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622729:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622737:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622742:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622748:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622755:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622762:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622781:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622788:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622794:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622813:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622819:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622898:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622906:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622913:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622919:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622926:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622934:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622940:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622945:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622962:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622967:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622972:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622980:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.622986:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.623009:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839744.635050:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ab744629200:6494] 0 exiting: rc = 1 00000100:00100000:1.0:1788839744.635050:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ab775023c00:6495] 1 exiting: rc = 0 00000100:00100000:3.0:1788839744.635147:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635155:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635164:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635170:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635176:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635181:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635186:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635191:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635196:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635201:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635206:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635211:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635216:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635222:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635226:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635231:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635236:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635241:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635247:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635262:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635267:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635272:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635277:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635281:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635286:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635290:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635295:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635299:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635304:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635309:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635314:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635320:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635325:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635330:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635336:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635342:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635346:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635352:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635357:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635362:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635366:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635371:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635376:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635382:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635399:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635403:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635409:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635413:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635418:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635423:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635428:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635433:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635438:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635442:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635454:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635459:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635464:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635469:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635473:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635478:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635484:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635489:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635494:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635508:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.635962:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ab744625600:6496] 0 exiting: rc = 1 00000100:00100000:0.0:1788839744.636212:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ab744625800:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1788839744.638984:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.638995:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639000:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639005:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639011:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639016:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639022:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639027:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639032:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639037:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639043:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639048:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639053:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639058:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639064:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639069:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639074:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639079:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639084:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639089:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639094:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639100:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639105:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639110:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639130:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639135:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639141:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639146:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639151:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639156:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639162:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639167:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639172:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639178:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639183:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639188:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639193:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639198:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639204:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639209:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639214:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639219:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639225:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639229:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639235:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639240:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639245:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639250:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639255:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639260:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639265:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639269:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639274:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639279:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639284:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639289:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639294:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639312:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639319:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639330:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639334:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639339:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639344:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.639349:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839744.640426:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ab744624600:6499] 1 exiting: rc = 0 00000100:00100000:1.0:1788839744.640457:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ab744625e00:6498] 0 exiting: rc = 1 00000100:00100000:3.0:1788839744.640696:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640703:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640708:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640714:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640719:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640725:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640731:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640737:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640742:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640747:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640752:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640758:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640764:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640797:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640803:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640809:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640815:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640820:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640825:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640829:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640834:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640839:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640843:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640848:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640853:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640857:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640862:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640867:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640872:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640877:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640894:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640899:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640903:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640908:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640914:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640919:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640923:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640929:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640934:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640939:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640944:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.640949:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641044:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641051:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641056:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641060:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641066:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641070:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641076:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641081:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641086:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641091:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641096:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641101:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641106:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641111:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641116:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641121:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641125:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641131:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641136:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641141:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641146:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839744.641152:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.642918:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ab744621c00:6500] 0 exiting: rc = 1 00000100:00100000:0.0:1788839744.643160:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ab744621000:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1788839744.644051:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ab744621600:6502] 2 exiting: rc = 0 00000100:00100000:0.0:1788839744.645253:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645261:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645266:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645272:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645279:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645285:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645290:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645295:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645311:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645316:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645322:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645327:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645333:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645358:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645365:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645370:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645377:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645382:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645397:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645403:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645408:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645414:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645421:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645427:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645432:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645438:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645443:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645449:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645454:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645460:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645466:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645471:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645477:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645497:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645516:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645522:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645529:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645548:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645555:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645561:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645567:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645896:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645902:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645909:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645914:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645921:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645926:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645933:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645938:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645944:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645950:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645967:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645974:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645980:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645986:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645992:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.645998:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646004:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646010:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646015:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646021:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646042:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646049:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839744.646055:0:15324:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788839744.651941:0:15324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839744.651955:0:15324:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788839744.651961:0:15324:0:(genops.c:885:class_export_put()) final put ffff8ab75fdf7800/MDS_uuid 00000020:00000080:0.0:1788839744.651965:0:15324:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab75fdf7800/MDS_uuid for MDS 00000020:01000000:0.0:1788839744.651983:0:15324:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788839744.652121:0:15324:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788839745.414376:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839746.431922:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839747.454930:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839747.454940:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839747.454950:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839747.454954:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788839747.454959:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839747.454968:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 397 00000100:00080000:2.0:1788839747.454973:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788839747.454980:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab77e444000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839747.455021:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f9500 x1875734060762112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839747.455092:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839747.455096:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788839747.455098:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ab000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839747.455105:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 397 00000100:00080000:2.0:1788839747.455111:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788839747.455117:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ab000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839747.455144:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819faa00 x1875734060762368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839747.455511:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060762112:0@lo:38:kworker.0 00000400:00000100:3.0:1788839747.455578:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762112 offset 0 length 520: 4 00000100:00100000:3.0:1788839747.455665:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060762368:0@lo:38:kworker.0 00000400:00000100:3.0:1788839747.455693:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762368 offset 0 length 520: 4 00000100:00100000:2.0:1788839747.457323:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060762240:0@lo:400:kworker.0 00000400:00000100:2.0:1788839747.457425:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762240 offset 0 length 224: 4 00000100:00100000:2.0:1788839747.462446:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839747.462480:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060762496:0@lo:400:kworker.0 00000400:00000100:2.0:1788839747.462565:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762496 offset 0 length 224: 4 00010000:00010000:0.0:1788839747.465711:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788839748.442902:0:15525:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788839748.466066:0:15525:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788839748.466146:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839748.466191:0:15525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839748.466200:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839748.466207:0:15525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839748.466265:0:15525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788839748.466272:0:15525:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788839748.466311:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839748.466327:0:15525:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819f9500 x1875734060762112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839762 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839748.466348:0:15525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788839748.466355:0:15525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788839748.466372:0:15525:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788839748.466378:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839748.466382:0:15525:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819f9500 x1875734060762112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839762 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839748.466389:0:15525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788839748.466392:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 18s for inflight to error out 00000100:00100000:3.0:1788839748.466465:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060762112:0@lo:38:kworker.0 00000100:00080000:3.0:1788839748.471100:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788839748.471128:0:15525:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819fb100 x1875734060762240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839748.471160:0:15525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788839748.471171:0:15525:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788839748.471213:0:15525:0:(import.c:65:import_set_state_nolock()) ffff8ab646525800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788839748.471256:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060762624:0@lo:39:umount.0 00000100:00100000:0.0:1788839748.471259:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060762240:0@lo:400:kworker.0 00000400:00000100:3.0:1788839748.471321:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762624 offset 0 length 224: 4 00010000:00010000:1.0:1788839748.472452:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839748.472467:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839748.472481:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab740031000 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839748.472486:0:6475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839748.472498:0:6475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788839748.472533:0:6475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839748.472540:0:6475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788839748.472543:0:6475:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788839748.472548:0:6475:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788839748.472573:0:6475:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:1.0:1788839748.472578:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839748.472586:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031000/0xad5b343a26572b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b5a expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839748.472652:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839748.472655:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839748.472657:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839748.479101:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839749.503022:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839749.504391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839749.504399:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839749.504403:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839749.504407:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788839749.504666:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839749.504696:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060762752:0@lo:400:kworker.0 00000400:00000100:0.0:1788839749.504795:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762752 offset 0 length 224: 4 00000001:00100000:2.0:1788839750.020546:0:9483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788839750.020557:0:9483:0:(genops.c:885:class_export_put()) final put ffff8ab646b3e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788839750.021452:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b3e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788839750.021513:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646b38000 for lustre-OST0001 00000001:00100000:0.0:1788839750.024449:0:8397:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788839750.024458:0:8397:0:(genops.c:885:class_export_put()) final put ffff8ab742bef000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788839750.026305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab742bef000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788839750.026378:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab742bed800 for lustre-OST0000 00010000:00010000:0.0:1788839750.527571:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839751.553332:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839752.511551:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839752.511565:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839752.511568:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839752.511572:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839752.511699:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060762880:0@lo:400:kworker.0 00000400:00000100:2.0:1788839752.511804:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060762880 offset 0 length 224: 4 00010000:00010000:0.0:1788839752.577004:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839753.598980:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839754.623152:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839744/real 1788839744] req@ffff8ab777cab800 x1875734060761984/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839754 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839754.623201:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777cab800 x1875734060761984/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839754 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839754.623224:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839754.623242:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788839754.623247:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060761984:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1788839754.623590:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839754.623597:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788839754.623600:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839754.623606:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 399 00000100:00080000:0.0:1788839754.623612:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839754.623620:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab744672800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839754.623663:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777caaa00 x1875734060763008/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839754.623692:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788839754.623697:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839754.623944:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060763136:0@lo:400:kworker.0 00000400:00000100:3.0:1788839754.624014:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060763136 offset 0 length 224: 4 00010000:00010000:1.0:1788839754.624171:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839754.624358:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060763008:0@lo:250:kworker.0 00000400:00000100:2.0:1788839754.624388:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060763008 offset 0 length 520: 4 00010000:00010000:2.0:1788839755.646985:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839756.672086:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839757.696928:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839758.719203:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839758.727264:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839748/real 1788839748] req@ffff8ab781a4aa00 x1875734060762624/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839758 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839758.727330:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab781a4aa00 x1875734060762624/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839758 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788839758.727353:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646525800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788839758.727376:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060762624:0@lo:39:umount.0 00000100:00080000:1.0:1788839758.728391:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839758.728403:0:15525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788839758.728413:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788839758.734244:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.734283:0:15525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.736984:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.736996:0:15525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.737033:0:15525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839758.737044:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.737051:0:15525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.737057:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.737063:0:15525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839758.737083:0:15525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788839758.737088:0:15525:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788839758.737126:0:15525:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788839758.737131:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788839758.737135:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839758.737141:0:15525:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788839758.737146:0:15525:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8ab777fb19b8) has no exports 00000020:00080000:1.0:1788839758.737186:0:15525:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8ab777fb19b8) has no exports 00010000:00010000:2.0:1788839758.738612:0:15122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839758.738634:0:15122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738650:0:15122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839758.738656:0:15122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738695:0:15122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839758.738705:0:15122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839758.738712:0:15122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788839758.738716:0:15122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788839758.738720:0:15122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788839758.738746:0:15122:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:2.0:1788839758.738750:0:15122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738757:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647842200/0xad5b343a26572b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b68 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738842:0:15122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839758.738847:0:15122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738854:0:15122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839758.738857:0:15122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738864:0:15122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839758.738871:0:15122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839758.738888:0:15122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788839758.738891:0:15122:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788839758.738894:0:15122:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788839758.738902:0:15122:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:2.0:1788839758.738905:0:15122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738911:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647959c00/0xad5b343a26572de5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572dec expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839758.738921:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839758.738924:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839758.738926:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839758.740965:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788839758.746900:0:15525:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab646625de0 - data ffff8ab752441510/ffff8ab777d3a000 00000020:01000000:1.0:1788839758.747107:0:15525:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab646625660 - data ffff8ab75f29a510/ffff8ab646685800 00100000:10000000:1.0:1788839758.761647:0:15525:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788839758.787698:0:15525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265728b3 00000020:00000080:3.0:1788839758.787721:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab641af1000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788839758.788224:0:15525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab777b41000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788839758.788229:0:15525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab777b41000 2 00000020:01000004:3.0:1788839758.788233:0:15525:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab777b41000 from lustre-OST0000 00000020:00000080:3.0:1788839758.788260:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839758.788271:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788839758.788275:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab641af7000/lustre-OST0000_UUID 00000020:00000080:3.0:1788839758.788278:0:15525:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788839758.788303:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788839758.788380:0:15525:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788839758.788386:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788839758.788390:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839758.788395:0:15525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788839758.788403:0:15525:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ab744392000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788839758.788409:0:15525:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8ab777fb4d28) has exports, disconnecting them 00000020:00080000:3.0:1788839758.788415:0:15525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ab744392000), last request at 1788839525 00000020:00000080:3.0:1788839758.788419:0:15525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265728dd 00000020:00080000:3.0:1788839758.788431:0:15525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab744392000): rc 0 00000020:00000080:3.0:1788839758.788436:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab744392000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788839758.789680:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af1000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788839758.789694:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744392000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788839758.790836:0:15525:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788839758.790843:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839758.790849:0:15525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839758.790856:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839758.790965:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e444000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788839758.791211:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839758.791219:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788839758.791224:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab641af6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788839758.791227:0:15525:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788839758.791239:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788839758.791314:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788839758.791319:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839758.791323:0:15525:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788839758.791331:0:15525:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8ab646522000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788839758.791338:0:15525:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8ab646694d28) has exports, disconnecting them 00000020:00080000:2.0:1788839758.791343:0:15525:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8ab646522000), last request at 1788839525 00000020:00000080:2.0:1788839758.791369:0:15525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265728f2 00000020:00080000:2.0:1788839758.791387:0:15525:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646522000): rc 0 00000020:00000080:2.0:1788839758.791394:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab646522000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788839758.792130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646522000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788839758.864873:0:15525:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788839758.864883:0:15525:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788839758.864888:0:15525:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839758.864896:0:15525:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788839758.865151:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab646525800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788839758.865329:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839758.865339:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788839758.865344:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab646527800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788839758.865348:0:15525:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646527800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788839758.865354:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788839758.865494:0:15525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab777b41000 1 00000020:00000080:2.0:1788839758.865502:0:15525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657287b 00000020:00000080:2.0:1788839758.865508:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab777b8f000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788839758.865523:0:15525:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788839758.865527:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839758.865531:0:15525:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788839758.865535:0:15525:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8ab77e4f8000) has no exports 00000020:00000080:1.0:1788839758.865594:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b8f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788839758.940259:0:15525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839758.940389:0:15525:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788839758.940395:0:15525:0:(genops.c:885:class_export_put()) final put ffff8ab77e7a6800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788839758.940400:0:15525:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e7a6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788839758.940406:0:15525:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788839758.940519:0:15525:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab77e7a2000 00000020:02000400:1.0:1788839758.940561:0:15525:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788839759.744020:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788839759.744569:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839759.744574:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839759.744576:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788839759.744579:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788839759.744638:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060763264:0@lo:400:kworker.0 00000400:00000100:1.0:1788839759.744687:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060763264 offset 0 length 224: 4 00010000:00010000:3.0:1788839760.767470:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839761.792115:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788839762.786364:0:15727:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788839762.807720:0:15727:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788839762.807826:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839762.807898:0:15727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839762.807906:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839762.807913:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839762.807933:0:15727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788839762.807937:0:15727:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788839762.807962:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839762.807972:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819faa00 x1875734060762368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839762 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.807984:0:15727:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788839762.807989:0:15727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839762.807995:0:15727:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ab000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788839762.808000:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788839762.808003:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819faa00 x1875734060762368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788839762 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.808009:0:15727:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788839762.808012:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788839762.809274:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839762.809285:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839762.809295:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839762.809299:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839762.809308:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839762.809316:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839762.809322:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788839762.809324:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788839762.809327:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788839762.809340:0:6476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:0.0:1788839762.809343:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839762.809350:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647843800/0xad5b343a26572b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b3e expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839762.809363:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839762.809365:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839762.809366:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839762.809384:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839747/real 1788839747] req@ffff8ab7819faa00 x1875734060762368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788839762 ref 1 fl Rpc:EXNQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839762.809419:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CLOSED) req@ffff8ab7819faa00 x1875734060762368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788839762 ref 1 fl Rpc:EXNQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839762.809436:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060762368:0@lo:38:kworker.0 00000100:00080000:1.0:1788839762.811814:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839762.811830:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819fbb80 x1875734060762496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839763 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.811924:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab7819fa300 x1875734060762752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839765 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.811953:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab647bb7b80 x1875734060762880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.811962:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab777caad80 x1875734060763136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839770 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.811970:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab647bb5f80 x1875734060763264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839775 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839762.811982:0:15727:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788839762.812010:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060763264:0@lo:400:kworker.0 00000100:00080000:1.0:1788839762.812077:0:15727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788839762.812099:0:15727:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bd800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788839762.812125:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060763392:0@lo:39:umount.0 00000400:00000100:1.0:1788839762.812168:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875734060763392 offset 0 length 224: 4 00000100:00100000:2.0:1788839762.812802:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060763136:0@lo:400:kworker.0 00000100:00100000:2.0:1788839762.812812:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875734060762496:0@lo:400:kworker.0 00000100:00100000:2.0:1788839762.812851:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060762880:0@lo:400:kworker.0 00000100:00100000:2.0:1788839762.812858:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060762752:0@lo:400:kworker.0 00010000:00010000:3.0:1788839762.815291:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839763.842785:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839764.863014:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788839764.865486:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788839764.865494:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788839765.888545:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839766.911228:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839767.936494:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839768.960054:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839769.983058:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839769.983532:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839754/real 1788839754] req@ffff8ab777caaa00 x1875734060763008/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839769 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839769.983579:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777caaa00 x1875734060763008/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788839769 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839769.983598:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839769.983606:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788839769.983609:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060763008:0@lo:250:kworker.0 00000100:00080000:3.0:1788839769.984305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 096dcd45-3d06-4359-b81b-4bde04036a06->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788839769.984313:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788839769.984317:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839769.984322:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 409 00000100:00080000:3.0:1788839769.984327:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.152@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788839769.984333:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab744672800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839769.984392:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a4aa00 x1875734060763520/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839769.984523:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060763520:0@lo:250:kworker.0 00000400:00000100:2.0:1788839769.984581:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875734060763520 offset 0 length 520: 4 00010000:00010000:0.0:1788839771.007646:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839772.031507:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839762/real 1788839762] req@ffff8ab647bb5f80 x1875734060763392/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839772 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839772.031550:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab647bb5f80 x1875734060763392/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788839772 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839772.031569:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e6bd800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788839772.031595:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060763392:0@lo:39:umount.0 00000100:00080000:1.0:1788839772.031813:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788839772.031818:0:15727:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788839772.031823:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788839772.032843:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032858:0:15727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032866:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032950:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032974:0:15727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839772.032982:0:15727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032988:0:15727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032994:0:15727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.032999:0:15727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839772.033007:0:15727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788839772.033011:0:15727:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788839772.033032:0:15727:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788839772.033035:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788839772.033039:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839772.033044:0:15727:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788839772.033047:0:15727:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8ab6466919b8) has no exports 00000020:00080000:1.0:1788839772.033093:0:15727:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8ab6466919b8) has no exports 00010000:00010000:3.0:1788839772.033330:0:15122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839772.033342:0:15122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033352:0:15122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839772.033358:0:15122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033367:0:15122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839772.033374:0:15122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839772.033379:0:15122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839772.033381:0:15122:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788839772.033383:0:15122:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788839772.033396:0:15122:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:3.0:1788839772.033399:0:15122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033404:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab777de6200/0xad5b343a26572b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572b4c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033418:0:15122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839772.033421:0:15122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033439:0:15122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab7413cb800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839772.033442:0:15122:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033449:0:15122:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839772.033461:0:15122:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839772.033466:0:15122:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788839772.033468:0:15122:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788839772.033472:0:15122:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788839772.033478:0:15122:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:3.0:1788839772.033480:0:15122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033489:0:15122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab7413cb800/0xad5b343a26572dd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572dde expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.033502:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839772.033504:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839772.033505:0:15122:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839772.033551:0:6475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839772.033600:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788839772.045401:0:15727:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab647442780 - data ffff8ab75f358bd0/ffff8ab647568c00 00000020:01000000:1.0:1788839772.045521:0:15727:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab646625540 - data ffff8ab75f05d000/ffff8ab777de9000 00100000:10000000:1.0:1788839772.096700:0:15727:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788839772.124308:0:15727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265729d9 00000020:00000080:3.0:1788839772.124328:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab646b63800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788839772.124346:0:15727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab646536000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788839772.124349:0:15727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab646536000 2 00000020:01000004:3.0:1788839772.124352:0:15727:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab646536000 from lustre-OST0001 00000020:00000080:3.0:1788839772.124376:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839772.124394:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788839772.124397:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab641af4800/lustre-OST0001_UUID 00000020:00000080:3.0:1788839772.124400:0:15727:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab641af4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788839772.124406:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1788839772.124686:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646b63800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788839772.124965:0:15727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 096dcd45-3d06-4359-b81b-4bde04036a06->MGS 00010000:00010000:3.0:1788839772.124981:0:15727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a26572732 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839772.124993:0:15727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a26572732 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839772.125000:0:15727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788839772.125002:0:15727:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788839772.125006:0:15727:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788839772.125019:0:15727:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:3.0:1788839772.125023:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab741465c00/0xad5b343a26572732 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572739 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839772.125039:0:15727:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839772.125046:0:15727:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839772.125052:0:15727:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788839772.125054:0:15727:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788839772.125055:0:15727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788839772.125062:0:15727:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab744672800 00010000:00010000:3.0:1788839772.125065:0:15727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab740031e00/0xad5b343a26572ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xad5b343a26572bae expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788839772.125079:0:15727:0:(import.c:65:import_set_state_nolock()) ffff8ab744672800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788839772.125090:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788839772.125092:0:15727:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788839772.125093:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788839772.125097:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788839772.125107:0:15727:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab781a4aa00 x1875734060763520/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788839789 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788839772.125122:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788839772.125124:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788839772.125286:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:096dcd45-3d06-4359-b81b-4bde04036a06:3613:1875734060763520:0@lo:250:kworker.0 10000000:01000000:3.0:1788839772.128109:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788839772.128126:0:15727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a2657262f 00000020:00000080:3.0:1788839772.128135:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab744676000/096dcd45-3d06-4359-b81b-4bde04036a06 00000020:01000000:3.0:1788839772.128164:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:3.0:1788839772.128175:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839772.128190:0:15727:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788839772.128194:0:15727:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ab7486e8000) has no exports 10000000:01000000:2.0:1788839772.128269:0:6483:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1788839772.128519:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744676000/096dcd45-3d06-4359-b81b-4bde04036a06 for MGC192.168.203.152@tcp 10000000:01000000:3.0:1788839772.128654:0:15727:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:3.0:1788839772.128657:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788839772.128660:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788839772.128663:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788839772.128666:0:15727:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788839772.128714:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788839772.128720:0:15727:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid 096dcd45-3d06-4359-b81b-4bde04036a06) 00000020:01000000:3.0:1788839772.128727:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788839772.128730:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788839772.128734:0:15727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788839772.128740:0:15727:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ab646536800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788839772.128745:0:15727:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8ab77e4fb370) has exports, disconnecting them 00000020:00080000:3.0:1788839772.128750:0:15727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ab646536800), last request at 1788839546 00000020:00000080:3.0:1788839772.128754:0:15727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a03 00000020:00080000:3.0:1788839772.128766:0:15727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646536800): rc 0 00000020:00000080:3.0:1788839772.128799:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab646536800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788839772.130943:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab744672800 for MGC192.168.203.152@tcp 00000020:00000080:0.0:1788839772.130960:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab744677800/096dcd45-3d06-4359-b81b-4bde04036a06 00000020:00000080:0.0:1788839772.130963:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab744677800/096dcd45-3d06-4359-b81b-4bde04036a06 for MGC192.168.203.152@tcp 00000020:01000000:0.0:1788839772.130976:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (096dcd45-3d06-4359-b81b-4bde04036a06) 00000020:00000080:0.0:1788839772.131308:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646536800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788839772.132042:0:15727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788839772.132057:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788839772.132061:0:15727:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788839772.132066:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788839772.132235:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788839772.132243:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788839772.132248:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788839772.132272:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788839772.132276:0:15727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788839772.132283:0:15727:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8ab646534000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788839772.132291:0:15727:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8ab77e7919b8) has exports, disconnecting them 00000020:00080000:2.0:1788839772.132295:0:15727:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8ab646534000), last request at 1788839546 00000020:00000080:2.0:1788839772.132299:0:15727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a26572a18 00000020:00080000:2.0:1788839772.132327:0:15727:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab646534000): rc 0 00000020:00000080:2.0:1788839772.132331:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab646534000/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788839772.133913:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab6475ab000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788839772.133925:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab77e5cc800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788839772.133929:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab77e5cc800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788839772.133936:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788839772.133999:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646534000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788839772.150952:0:15727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788839772.150960:0:15727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788839772.150964:0:15727:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788839772.150972:0:15727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788839772.151005:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab77e6bd800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788839772.182268:0:15122:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788839772.183466:0:6475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788839772.183718:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788839772.184184:0:6470:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ab745d60800:6470] 0 exiting: rc = 1 00000100:00100000:0.0:1788839772.184279:0:6471:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ab745d60a00:6471] 1 exiting: rc = 0 00000100:00100000:0.0:1788839772.184405:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788839772.185044:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ab745d21c00:6474] 2 exiting: rc = 0 00000100:00100000:3.0:1788839772.185224:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ab745d21000:6473] 1 exiting: rc = 0 00000100:00100000:0.0:1788839772.185379:0:8419:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ab641ad9400:8419] 3 exiting: rc = 0 00000100:00100000:0.0:1788839772.185458:0:6472:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ab745d21600:6472] 0 exiting: rc = 1 00000100:00100000:1.0:1788839772.185761:0:10307:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8ab647891a00:10307] 4 exiting: rc = 0 00000100:00100000:0.0:1788839772.186270:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186278:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186285:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186291:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186297:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186304:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186309:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186381:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186389:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186394:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186399:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186405:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186411:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186417:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186424:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186429:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186435:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186442:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186447:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186454:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186460:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186465:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186471:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186476:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186480:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186485:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186561:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186568:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186573:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186578:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186583:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186656:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186673:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186678:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186684:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186689:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186694:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186699:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186704:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186709:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186714:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186719:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186724:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186729:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186734:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186739:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186745:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186750:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186756:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186761:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186766:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186895:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186901:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186906:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.186911:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187183:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187192:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187205:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187211:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187216:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187221:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187226:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187231:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.187237:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788839772.188898:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788839772.188908:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788839772.188980:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab646530000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788839772.188995:0:15727:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab646530000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788839772.189001:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788839772.189180:0:15727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab646536000 1 00000020:00000080:0.0:1788839772.189187:0:15727:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xad5b343a265729a8 00000020:00000080:0.0:1788839772.189193:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab781981800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788839772.189220:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788839772.189225:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788839772.189229:0:15727:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788839772.189233:0:15727:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8ab777fb0000) has no exports 00000020:00000080:2.0:1788839772.189269:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab781981800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788839772.228874:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839772.228898:0:15727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788839772.228904:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab781981000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788839772.228908:0:15727:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab781981000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788839772.229135:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788839772.229450:0:15727:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab646533800 00000020:01000000:1.0:1788839772.229472:0:15727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788839772.229476:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788839772.229480:0:15727:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788839772.229484:0:15727:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ab777fb3370) has no exports 00000020:00000080:1.0:1788839772.229517:0:15727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788839772.229524:0:15727:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788839772.229527:0:15727:0:(genops.c:885:class_export_put()) final put ffff8ab777b8b800/OSS_uuid 00000020:00000080:1.0:1788839772.229529:0:15727:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab777b8b800/OSS_uuid for OSS 00000020:01000000:1.0:1788839772.229533:0:15727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788839772.229623:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ab777be5400:8403] 0 exiting: rc = 1 00000100:00080000:1.0:1788839772.229729:0:6482:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788839772.229960:0:8539:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8ab781933800:8539] 4 exiting: rc = 0 00000100:00100000:1.0:1788839772.230030:0:8404:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ab777b3b000:8404] 1 exiting: rc = 0 00000100:00100000:1.0:1788839772.230585:0:8538:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ab64653b800:8538] 3 exiting: rc = 0 00000100:00100000:1.0:1788839772.230655:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ab77781be00:8405] 2 exiting: rc = 0 00000100:00100000:1.0:1788839772.230721:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230728:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230735:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230740:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230745:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230751:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230756:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230761:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230839:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230846:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230851:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230856:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230860:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230876:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230881:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230886:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230891:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230896:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230902:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.230907:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231262:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231282:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231288:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231293:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231298:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231302:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231307:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231312:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231327:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231332:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231336:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231341:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231347:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231352:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231357:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231362:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231368:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231373:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231378:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231383:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231388:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231394:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231398:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231404:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231410:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231414:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231419:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231424:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231435:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231440:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231446:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231451:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231456:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231461:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231466:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231471:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231476:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231480:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231485:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231489:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231605:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231610:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231614:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.231623:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.240715:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ab77e4b0a00:8407] 1 exiting: rc = 0 00000100:00100000:1.0:1788839772.241083:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ab74861fa00:8406] 0 exiting: rc = 1 00000100:00100000:1.0:1788839772.241137:0:10769:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8ab647890c00:10769] 2 exiting: rc = 0 00000100:00100000:2.0:1788839772.241734:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241744:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241833:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241840:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241845:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241851:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241856:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241862:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241868:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241873:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241879:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241884:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241890:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241896:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241901:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241906:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.241911:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242037:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242041:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242053:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242057:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242062:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242078:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242083:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242088:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242093:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242097:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242103:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242107:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242113:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242118:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242123:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242129:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242134:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242139:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242144:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242149:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242154:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242160:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242165:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242170:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242175:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242181:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242299:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242305:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242310:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242382:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242389:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242394:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242399:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242403:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242408:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242413:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242418:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242424:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242430:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242436:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242459:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242464:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242469:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242474:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242479:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.242489:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.243576:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.253417:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ab777f49400:8408] 0 exiting: rc = 1 00000100:00100000:1.0:1788839772.253645:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ab777f49200:8409] 1 exiting: rc = 0 00000100:00100000:2.0:1788839772.254362:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ab78005ea00:8410] 2 exiting: rc = 0 00000100:00100000:1.0:1788839772.254816:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254824:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254829:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254834:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254840:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254846:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254861:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254869:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254874:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254880:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254885:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254891:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254896:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254902:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254935:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254941:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254946:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254952:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254958:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254964:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254970:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254976:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254981:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.254999:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255005:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255011:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255016:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255022:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255027:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255032:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255038:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255044:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255062:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255069:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255075:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255081:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255088:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255094:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255100:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255105:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255111:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255118:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255123:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255129:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255134:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255139:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255145:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255167:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255174:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255205:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255211:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255216:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255221:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255227:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255233:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255239:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255245:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255251:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255257:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255262:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255269:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255274:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255280:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788839772.255287:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.274330:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ab78005e600:8411] 0 exiting: rc = 1 00000100:00100000:0.0:1788839772.279073:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ab78005fa00:8412] 1 exiting: rc = 0 00000100:00100000:2.0:1788839772.279175:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279195:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279211:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279216:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279221:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279227:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279231:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279237:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279243:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279248:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279253:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279258:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279263:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279267:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279272:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279276:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279281:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279286:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279290:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279294:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279298:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279303:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279308:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279325:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279330:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279335:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279340:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279357:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279362:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279368:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279373:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279377:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279382:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279387:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279392:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279396:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279401:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279407:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279412:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279418:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279423:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279428:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279433:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279438:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279443:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279447:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279453:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279458:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279462:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279467:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279472:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279478:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279483:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279488:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279504:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279509:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279514:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279519:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279524:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279529:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279533:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279538:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279550:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.279554:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788839772.280332:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ab75f6a4c00:8413] 0 exiting: rc = 1 00000100:00100000:2.0:1788839772.283708:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ab77e49a600:8414] 1 exiting: rc = 0 00000100:00100000:2.0:1788839772.283834:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283843:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283857:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283867:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283874:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283881:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283886:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283893:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283898:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283919:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283926:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283947:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283955:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283960:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283965:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283971:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283976:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283982:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283987:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.283995:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284001:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284006:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284012:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284029:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284036:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284043:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284060:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284068:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284074:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284079:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284084:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284090:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284109:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284122:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284135:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284142:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284147:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284154:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284160:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284179:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284471:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284478:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284486:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284502:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284508:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284514:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284520:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284527:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284533:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284538:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284546:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284565:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284573:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284578:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284584:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284590:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284597:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284602:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284608:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284614:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284619:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284624:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284630:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788839772.284645:0:15727:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788839772.319414:0:15727:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788839792.250274:0:16492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788839803.214707:0:17092:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788839803.214713:0:17092:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1788839803.214715:0:17092:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788839803.214863:0:17092:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab64817e800 00000020:01000004:0.0:1788839803.214879:0:17092:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788839803.214886:0:17092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788839803.214900:0:17092:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ab6479ecd28) 00000020:00000080:0.0:1788839803.214912:0:17092:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839803.295553:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.300960:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788839803.306969:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.307871:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.308603:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.308843:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.309078:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788839803.309832:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788839803.310311:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788839803.310485:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.310722:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.311102:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788839803.311274:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788839803.311478:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788839803.311766:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788839803.312287:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.312683:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.312965:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.313235:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.313454:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.313674:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.313893:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.314101:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.314300:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.314497:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.314793:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.315060:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.315242:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.315462:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.315807:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.316166:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.316380:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.316603:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.316806:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.317045:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788839803.317277:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.317484:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788839803.317716:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788839803.318101:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788839803.318308:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788839803.318490:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788839803.318750:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788839803.319049:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788839803.319233:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788839803.319429:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788839803.319663:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788839803.319878:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788839803.321394:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788839803.321894:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788839803.322104:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788839803.322495:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788839803.322809:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788839803.323092:0:17092:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:01000000:3.0:1788839803.324121:0:17092:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788839803.324323:0:17092:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788839803.324330:0:17092:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839803.324342:0:17092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573bec 00000020:01000004:3.0:1788839803.324349:0:17092:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788839803.324361:0:17092:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788839803.324366:0:17092:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab64817e800 from MGS 00000020:01000004:3.0:1788839803.324370:0:17092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788839803.324379:0:17092:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ab6479a3370) 00000020:00000080:3.0:1788839803.324389:0:17092:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788839803.324445:0:17092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab64817e800 from MGS, refs=2 00080000:01000000:3.0:1788839803.324450:0:17092:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788839803.324455:0:17092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573bfa 00000100:00100000:3.0:1788839803.324707:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788839803.324881:0:17092:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788839803.324887:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788839803.325450:0:17092:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788839803.325457:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788839803.326189:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839803.326354:0:17092:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788839803.326359:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788839803.326939:0:17092:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788839803.326946:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788839803.327289:0:17092:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788839803.327295:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788839803.328165:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839803.328168:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839803.328170:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839803.328395:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839803.328397:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839803.328399:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839803.328917:0:17092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788839803.332873:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788839803.335683:0:17092:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788839803.336580:0:17104:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788839803.336677:0:17092:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788839803.336710:0:17092:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788839803.338828:0:17092:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788839803.339151:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839803.339334:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788839803.339341:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788839803.344859:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788839803.344877:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788839803.349051:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788839803.349063:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788839803.350163:0:17092:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788839803.350184:0:17092:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:2.0:1788839803.350186:0:17092:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788839803.350216:0:17092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:2.0:1788839803.350229:0:17092:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff8ab777fb4d28) 00000020:00000080:2.0:1788839803.350243:0:17092:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788839803.350317:0:17092:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab646b3a800@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839803.350464:0:17092:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:2.0:1788839803.350470:0:17092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788839803.350961:0:17109:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788839803.353870:0:17110:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788839803.353924:0:17092:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid d4b73860-6950-4a5d-8d03-52a643e5ff43) 00000020:00000080:2.0:1788839803.353945:0:17092:0:(genops.c:1385:class_connect()) connect: client d4b73860-6950-4a5d-8d03-52a643e5ff43, cookie 0xad5b343a26573c08 00000100:00080000:2.0:1788839803.353957:0:17092:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839803.353964:0:17092:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff8ab646b3a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839803.354741:0:17092:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f8a80 x1875734060763648/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839803.354867:0:17092:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d4b73860-6950-4a5d-8d03-52a643e5ff43->MGS 00000020:01000004:2.0:1788839803.354886:0:17092:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788839803.354891:0:17092:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788839803.354904:0:17092:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ab777fb3370) 00000020:00000080:2.0:1788839803.354917:0:17092:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788839803.357139:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060763648:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788839803.357216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.357354:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060763648 00000100:00100000:1.0:1788839803.357362:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060763648 00000100:00100000:1.0:1788839803.359055:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839803.359066:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875734060763648:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788839803.359098:0:17105:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d4b73860-6950-4a5d-8d03-52a643e5ff43@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:1.0:1788839803.359127:0:17105:0:(genops.c:1385:class_connect()) connect: client d4b73860-6950-4a5d-8d03-52a643e5ff43, cookie 0xad5b343a26573c16 00000100:00080000:1.0:1788839803.359249:0:17105:0:(import.c:65:import_set_state_nolock()) ffff8ab648899000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839803.359331:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+5:3613:x1875734060763648:12345-0@lo:250:mount.lustre.0 Request processed in 265us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839803.359338:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839803.359852:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788839803.359861:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:3.0:1788839803.359868:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788839803.359873:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788839803.359876:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b3a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788839803.359878:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788839803.359887:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788839803.359892:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4b73860-6950-4a5d-8d03-52a643e5ff43:3613:1875734060763648:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788839803.365431:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839803.365643:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839803.365650:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788839803.366240:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839803.366248:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788839803.368312:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788839803.368322:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788839803.369077:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839803.369260:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788839803.369266:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788839803.369748:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788839803.369755:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788839803.416496:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839803.416705:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788839803.416710:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788839803.419748:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788839803.419759:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788839803.421035:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839803.421546:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788839803.421553:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788839803.423045:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788839803.423055:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788839803.426937:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839803.427158:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839803.427165:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788839803.429583:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839803.429596:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788839803.430529:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788839803.430941:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788839803.430948:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788839803.431547:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788839803.431554:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788839803.456110:0:17092:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788839803.457560:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788839803.457569:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788839803.463257:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788839803.463273:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788839803.467611:0:17092:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788839803.467628:0:17092:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788839803.469349:0:17092:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788839803.469377:0:17092:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788839803.469383:0:17092:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788839803.469545:0:17092:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788839803.469577:0:17092:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788839803.469581:0:17092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788839803.469583:0:17092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839803.469584:0:17092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839803.469585:0:17092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839803.469587:0:17092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839803.469588:0:17092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839803.469589:0:17092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839803.469594:0:17092:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839803.469595:0:17092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839803.469597:0:17092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839803.469599:0:17092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788839803.469601:0:17092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839803.469602:0:17092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788839803.469603:0:17092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839803.469603:0:17092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839803.469604:0:17092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839803.469605:0:17092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839803.469606:0:17092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788839803.469607:0:17092:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788839803.469608:0:17092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839803.469608:0:17092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788839803.469632:0:17092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788839803.469720:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060763776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839803.470164:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.470261:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e4aec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839803.470509:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060763776 00000100:00100000:1.0:1788839803.470518:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060763776 00000100:00100000:1.0:1788839803.470597:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839803.470607:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+5:17092:x1875734060763776:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788839803.470665:0:17108:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788839803.470668:0:17108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788839803.470671:0:17108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788839803.471138:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788839803.471898:0:17108:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1788839803.474612:0:17130:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788839803.474619:0:17130:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1788839803.474623:0:17130:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788839803.474625:0:17130:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788839803.475198:0:17130:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788839803.475556:0:17108:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788839803.475568:0:17108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788839803.478035:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+5:17092:x1875734060763776:12345-0@lo:253:mount.lustre.0 Request processed in 7421us (7863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.478055:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839803.478187:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060763776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839803.478203:0:17092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788839803.478207:0:17092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839803.478208:0:17092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788839803.478210:0:17092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839803.478270:0:17092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839803.478283:0:17092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839803.478285:0:17092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839803.478286:0:17092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839803.478288:0:17092:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788839803.478290:0:17092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839803.478291:0:17092:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788839803.478313:0:17092:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab64817e800 from lustre-MDT0000 10000000:01000000:3.0:1788839803.478343:0:17092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788839803.478346:0:17092:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788839803.478350:0:17092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab777fb4d28 10000000:01000000:3.0:1788839803.478354:0:17092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839803.478361:0:17092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab777fb4d28 from 1 10000000:01000000:3.0:1788839803.478364:0:17092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788839803.478397:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.478407:0:17092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.478416:0:17092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.478435:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060763904:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839803.478544:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.478617:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839803.478743:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060763904 00000100:00100000:1.0:1788839803.478750:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060763904 00000100:00100000:1.0:1788839803.478968:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839803.478996:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+5:17092:x1875734060763904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839803.479010:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839803.479026:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959c00/0xad5b343a26573c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573c1d expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.479058:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959c00/0xad5b343a26573c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573c1d expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.479068:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959c00/0xad5b343a26573c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573c1d expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.479077:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959c00, rc 0) 00000100:00100000:1.0:1788839803.479117:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+6:17092:x1875734060763904:12345-0@lo:101:mount.lustre.0 Request processed in 132us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839803.479123:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839803.479267:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060763904:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839803.479281:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.479290:0:17092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.479348:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839803.479371:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.479578:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.479605:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764032 00000100:00100000:0.0:1788839803.479609:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764032 00000100:00100000:1.0:1788839803.479651:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839803.479658:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+6:17092:x1875734060764032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839803.479736:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+6:17092:x1875734060764032:12345-0@lo:501:mount.lustre.0 Request processed in 72us (357us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788839803.479742:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839803.479855:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764032:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788839803.479880:0:17092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788839803.479893:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.479901:0:17092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839803.479910:0:17092:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab64817e800 10000000:01000000:3.0:1788839803.479923:0:17092:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788839803.479927:0:17092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab64817e800 10000000:01000000:3.0:1788839803.479929:0:17092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788839803.479931:0:17092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab64817e800 from 1 10000000:01000000:3.0:1788839803.479933:0:17092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788839803.479948:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.479955:0:17092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.479963:0:17092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.479991:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839803.480021:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.480352:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839803.480385:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764160 00000100:00100000:2.0:1788839803.480390:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764160 00000100:00100000:2.0:1788839803.480411:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839803.480417:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+6:17092:x1875734060764160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839803.480425:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839803.480436:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843000/0xad5b343a26573c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573c2b expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.480462:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843000/0xad5b343a26573c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573c2b expref: 7 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.480471:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843000/0xad5b343a26573c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573c2b expref: 7 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.480478:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843000, rc 0) 00000100:00100000:2.0:1788839803.480544:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+7:17092:x1875734060764160:12345-0@lo:101:mount.lustre.0 Request processed in 126us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839803.480556:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839803.481060:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839803.481077:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.481086:0:17092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839803.481101:0:17092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788839803.481147:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.481155:0:17092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553c00/0xad5b343a26573c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c32 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839803.481162:0:17092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788839803.481166:0:17092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839803.481170:0:17092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab64817e800 10000000:01000000:3.0:1788839803.481172:0:17092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788839803.481175:0:17092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788839803.481177:0:17092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788839803.481193:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.481199:0:17092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.481207:0:17092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.481240:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839803.481267:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.481293:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.481377:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764288 00000100:00100000:0.0:1788839803.481381:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764288 00000100:00100000:0.0:1788839803.481411:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839803.481418:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+7:17092:x1875734060764288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839803.481426:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839803.481436:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfc800/0xad5b343a26573c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573c39 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.481460:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfc800/0xad5b343a26573c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573c39 expref: 8 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.481478:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfc800/0xad5b343a26573c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573c39 expref: 8 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.481485:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc800, rc 0) 00000100:00100000:0.0:1788839803.481512:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+8:17092:x1875734060764288:12345-0@lo:101:mount.lustre.0 Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.481518:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839803.481724:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839803.481742:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.481750:0:17092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.481942:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839803.481967:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.482102:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839803.482154:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764416 00000100:00100000:1.0:1788839803.482159:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764416 00000100:00100000:1.0:1788839803.482192:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839803.482199:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+8:17092:x1875734060764416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839803.482342:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17092:x1875734060764416:12345-0@lo:501:mount.lustre.0 Request processed in 142us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839803.482349:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839803.482474:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839803.482518:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839803.482559:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.482584:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.482754:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764544 00000100:00100000:0.0:1788839803.482758:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764544 00000100:00100000:0.0:1788839803.482806:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839803.482812:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17092:x1875734060764544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839803.483914:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17092:x1875734060764544:12345-0@lo:503:mount.lustre.0 Request processed in 1097us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.483925:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839803.484099:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060764544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839803.484831:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17131:1875734060764672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839803.484884:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.484915:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7450cc600 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.485093:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764672 00000100:00100000:0.0:1788839803.485099:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764672 00000100:00100000:0.0:1788839803.485142:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839803.485151:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17131:x1875734060764672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839803.486069:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17131:x1875734060764672:12345-0@lo:502:llog_process_th.0 Request processed in 916us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.486078:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839803.486420:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17131:1875734060764672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839803.486595:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.486607:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.486610:0:17131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788839803.486615:0:17131:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788839803.486618:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839803.486694:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ab77e794d28) 00000020:00000080:1.0:1788839803.486710:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788839803.486715:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788839803.486911:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788839803.486919:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573c4e 00000020:00000080:1.0:1788839803.487316:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788839803.487322:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.487327:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.487328:0:17131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788839803.487331:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.487335:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.487337:0:17131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788839803.487339:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839803.487348:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ab77e7919b8) 00000020:00000080:1.0:1788839803.487360:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788839803.487363:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788839803.487365:0:17131:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788839803.487368:0:17131:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788839803.487373:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839803.487433:0:17131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab64817e800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788839803.487521:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ab77e790000) 00000020:00000080:1.0:1788839803.487531:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788839803.487583:0:17131:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788839803.487588:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573c63 00000020:00000080:1.0:1788839803.487899:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788839803.487907:0:17131:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788839803.487918:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xad5b343a26573c6a 00080000:01000000:1.0:1788839803.487924:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788839803.487928:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573c71 00010000:00010000:3.0:1788839803.575137:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788839803.577242:0:17131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788839803.577652:0:17131:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788839803.579330:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ab6479a19b8) 00000020:00000080:3.0:1788839803.579347:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788839803.579428:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788839803.579438:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573c7f 00000020:00000080:3.0:1788839803.584517:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788839803.596335:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xad5b343a26573c86 00000020:00000080:1.0:1788839803.597046:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788839803.597058:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.597064:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.597066:0:17131:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788839803.597070:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839803.597073:0:17131:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788839803.597075:0:17131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839803.597076:0:17131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839803.597077:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839803.597080:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.597082:0:17131:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839803.597084:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.597089:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.597090:0:17131:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788839803.597095:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788839803.597134:0:17131:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788839803.597149:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.597153:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.597155:0:17131:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788839803.597158:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.597161:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.597162:0:17131:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788839803.597165:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788839803.597172:0:17131:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:1.0:1788839803.597198:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839803.597222:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8ab77e793370) 00000020:00000080:1.0:1788839803.597238:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788839803.597243:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788839803.597295:0:17131:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788839803.597301:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788839803.597307:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573c94 00010000:00080000:1.0:1788839803.597347:0:17131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab647a27800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839803.602449:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788839803.607445:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839803.607460:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788839803.607508:0:17131:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788839803.607528:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573c9b 00000100:00080000:1.0:1788839803.607538:0:17131:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839803.607544:0:17131:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab647a27800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839803.607581:0:17131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab647bb5500 x1875734060764800/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839803.607613:0:17131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788839803.607680:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.607684:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.607685:0:17131:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788839803.607688:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839803.607691:0:17131:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788839803.607693:0:17131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839803.607694:0:17131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839803.607696:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839803.607699:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.607700:0:17131:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839803.607703:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839803.607707:0:17131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788839803.607710:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.607712:0:17131:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788839803.607714:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788839803.607718:0:17131:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:1.0:1788839803.607739:0:17131:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788839803.607741:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839803.607753:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab7486e8000) 00000020:00000080:1.0:1788839803.607764:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788839803.607817:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788839803.607882:0:17131:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788839803.607888:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788839803.607894:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573ca9 00000100:00100000:3.0:1788839803.608195:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060764800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839803.608257:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839803.608362:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060764800 00000100:00100000:2.0:1788839803.608369:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060764800 00000100:00100000:2.0:1788839803.608407:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839803.608418:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060764800:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788839803.608434:0:17118:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788839803.609816:0:17131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab646534800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839803.610218:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1788839803.613208:0:17131:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788839803.613403:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788839803.614652:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839803.614847:0:17131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788839803.621544:0:17131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788839803.626863:0:17137:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788839803.626873:0:17137:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788839803.629284:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788839803.629299:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788839803.629345:0:17131:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788839803.629363:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573cb0 00000100:00080000:1.0:1788839803.629372:0:17131:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788839803.629378:0:17131:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab646534800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1788839803.629411:0:17131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab647bb6680 x1875734060764928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788839803.629431:0:17131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788839803.629473:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.629477:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.629479:0:17131:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788839803.629482:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788839803.629486:0:17131:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788839803.629487:0:17131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839803.629489:0:17131:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788839803.629490:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788839803.629493:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.629494:0:17131:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788839803.629496:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839803.629500:0:17131:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788839803.629503:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.629505:0:17131:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788839803.629508:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788839803.629512:0:17131:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:1.0:1788839803.629545:0:17131:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788839803.629547:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839803.629558:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab7486eb370) 00000020:00000080:1.0:1788839803.629568:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788839803.629573:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:3.0:1788839803.629746:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060764928:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788839803.629821:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060764928 offset 0 length 520: 4 00000004:00080000:1.0:1788839803.631040:0:17131:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788839803.631047:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788839803.631057:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xad5b343a26573cbe 00010000:00080000:1.0:1788839803.631087:0:17131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab647a27000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1788839803.632032:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788839803.632109:0:17131:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788839803.632125:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788839803.637132:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839803.637525:0:17131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788839803.637743:0:17131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788839803.638407:0:17139:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788839803.638412:0:17139:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788839803.639130:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788839803.639142:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839803.639179:0:17131:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788839803.639211:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573cc5 00000100:00080000:3.0:1788839803.639224:0:17131:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839803.639230:0:17131:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab647a27000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839803.639268:0:17131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a48e00 x1875734060765056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839803.639300:0:17131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788839803.639372:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839803.639376:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839803.639378:0:17131:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788839803.639381:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839803.639384:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839803.639386:0:17131:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839803.639388:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839803.639390:0:17131:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839803.639392:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839803.639394:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839803.639395:0:17131:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788839803.639398:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839803.639400:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839803.639401:0:17131:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839803.639411:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788839803.639445:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17131:1875734060765184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.639523:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.639558:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839803.639793:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765184 00000100:00100000:1.0:1788839803.639800:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765184 00000100:00100000:1.0:1788839803.639843:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788839803.639852:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17131:x1875734060765184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839803.639962:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17131:x1875734060765184:12345-0@lo:502:llog_process_th.0 Request processed in 111us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839803.639970:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839803.640098:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17131:1875734060765184:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788839803.640125:0:17131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839803.640129:0:17131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839803.640131:0:17131:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788839803.640134:0:17131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788839803.640184:0:17092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788839803.640443:0:17092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788839803.640463:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.640477:0:17092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553800/0xad5b343a26573c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c40 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839803.640486:0:17092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab64817e800 from 1 10000000:01000000:3.0:1788839803.640490:0:17092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839803.640518:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.640525:0:17092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.640534:0:17092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.640548:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839803.640588:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.640663:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.640817:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060765056:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788839803.640857:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060765056 offset 0 length 520: 4 00000100:00100000:1.0:1788839803.641349:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765312 00000100:00100000:1.0:1788839803.641356:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765312 00000100:00100000:1.0:1788839803.641434:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839803.641444:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+9:17092:x1875734060765312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839803.641455:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839803.641470:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573ccc expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.641505:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573ccc expref: 10 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.641515:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ccc expref: 10 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.641524:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959000, rc 0) 00000100:00100000:1.0:1788839803.641572:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+10:17092:x1875734060765312:12345-0@lo:101:mount.lustre.0 Request processed in 130us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839803.641579:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839803.641650:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839803.641665:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.641674:0:17092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839803.642152:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060764800:12345-0@lo:38:llog_process_th.0 Request processed in 33732us (33893us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788839803.642161:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788839803.642438:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839803.642444:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788839803.642448:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060764800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839803.642766:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765440:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788839803.643145:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.643223:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839803.643560:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765440 00000100:00100000:3.0:1788839803.643567:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765440 00000100:00100000:3.0:1788839803.643632:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839803.643641:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+10:17092:x1875734060765440:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788839803.643658:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788839803.643663:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788839803.643738:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+10:17092:x1875734060765440:12345-0@lo:256:mount.lustre.0 Request processed in 98us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.643745:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839803.643821:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765440:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788839803.644461:0:17092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839803.644488:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.644500:0:17092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839803.644508:0:17092:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab64817e800 from 1 10000000:01000000:1.0:1788839803.644511:0:17092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839803.644544:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.644552:0:17092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.644575:0:17092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839803.644594:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839803.644637:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.645659:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.645705:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765568 00000100:00100000:0.0:1788839803.645714:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765568 00000100:00100000:0.0:1788839803.645765:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839803.645881:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+10:17092:x1875734060765568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839803.645895:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839803.645912:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573cda expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.645936:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573cda expref: 11 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.645949:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573cda expref: 11 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.645957:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc000, rc 0) 00000100:00100000:0.0:1788839803.646047:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060765568:12345-0@lo:101:mount.lustre.0 Request processed in 218us (1408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.646054:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839803.646147:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765568:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839803.646161:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.646169:0:17092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839803.646363:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839803.646389:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.646408:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839803.646425:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765696 00000100:00100000:2.0:1788839803.646431:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765696 00000100:00100000:2.0:1788839803.646529:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839803.646539:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060765696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839803.646676:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060765696:12345-0@lo:501:mount.lustre.0 Request processed in 138us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839803.646683:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839803.646755:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839803.646804:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839803.646866:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.647237:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839803.647342:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765824 00000100:00100000:2.0:1788839803.647347:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765824 00000100:00100000:2.0:1788839803.647382:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839803.647391:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060765824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839803.647594:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060765824:12345-0@lo:503:mount.lustre.0 Request processed in 205us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839803.647602:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839803.648506:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060765824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839803.650911:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17141:1875734060765952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839803.650995:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839803.651084:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746768840 going to sleep for 11 seconds 00000100:00100000:2.0:1788839803.651767:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060765952 00000100:00100000:2.0:1788839803.651850:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060765952 00000100:00100000:2.0:1788839803.651907:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839803.651925:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17141:x1875734060765952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788839803.652832:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17141:x1875734060765952:12345-0@lo:502:llog_process_th.0 Request processed in 904us (1842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839803.652844:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839803.652957:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17141:1875734060765952:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839803.653000:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.653010:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653012:0:17141:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839803.653020:0:17141:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab64817e800 00000020:00000080:1.0:1788839803.653022:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839803.653029:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.653032:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653033:0:17141:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788839803.653035:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.653038:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653039:0:17141:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788839803.653042:0:17141:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab64817e800 00000020:00000080:1.0:1788839803.653044:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839803.653138:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.653142:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653143:0:17141:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788839803.653146:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.653148:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653149:0:17141:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839803.653153:0:17141:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab64817e800 00000020:00000080:1.0:1788839803.653155:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839803.653376:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.653381:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653382:0:17141:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839803.653385:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839803.653388:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.653389:0:17141:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788839803.653392:0:17141:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab64817e800 00000020:00000080:1.0:1788839803.653394:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788839803.653440:0:17141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17141:1875734060766080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788839803.653620:0:17141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.653734:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766080 00000100:00100000:3.0:1788839803.653741:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766080 00000100:00100000:1.0:1788839803.653917:0:17141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742f0d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788839803.654078:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839803.654090:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17141:x1875734060766080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.654295:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17141:x1875734060766080:12345-0@lo:502:llog_process_th.0 Request processed in 208us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.654304:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839803.654406:0:17141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17141:1875734060766080:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788839803.654429:0:17141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839803.654436:0:17141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839803.654438:0:17141:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788839803.654442:0:17141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788839803.654723:0:17092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788839803.654746:0:17092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839803.654791:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.654804:0:17092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839803.654862:0:17092:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839803.655158:0:17092:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab64817e800 10000000:01000000:3.0:1788839803.655161:0:17092:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab64817e800 10000000:01000000:3.0:1788839803.655166:0:17092:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839803.655173:0:17092:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab64817e800 from 1 10000000:01000000:3.0:1788839803.655176:0:17092:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839803.655209:0:17092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.655218:0:17092:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.655228:0:17092:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.655250:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060766208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839803.655294:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.655331:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839803.655378:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766208 00000100:00100000:1.0:1788839803.655384:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766208 00000100:00100000:1.0:1788839803.655426:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839803.655434:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060766208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839803.655444:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839803.655458:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647958800/0xad5b343a26573cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573ce8 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.655482:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958800/0xad5b343a26573cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573ce8 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.655493:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647958800/0xad5b343a26573cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ce8 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839803.655501:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958800, rc 0) 00000100:00100000:1.0:1788839803.655543:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17092:x1875734060766208:12345-0@lo:101:mount.lustre.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839803.655549:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839803.655614:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060766208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839803.655627:0:17092:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.655649:0:17092:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.655703:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060766336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839803.655728:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.655752:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.655822:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766336 00000100:00100000:0.0:1788839803.655835:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766336 00000100:00100000:0.0:1788839803.655870:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788839803.655877:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17092:x1875734060766336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839803.655995:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17092:x1875734060766336:12345-0@lo:501:mount.lustre.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.656002:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788839803.656513:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060766336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839803.656549:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060766464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839803.656594:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.656632:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.656966:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766464 00000100:00100000:0.0:1788839803.657089:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766464 00000100:00100000:0.0:1788839803.657123:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788839803.657129:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17092:x1875734060766464:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839803.657227:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17092:x1875734060766464:12345-0@lo:503:mount.lustre.0 Request processed in 98us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.657234:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839803.657529:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060766464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839803.658287:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17143:1875734060766592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.658454:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.658528:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839803.658564:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766592 00000100:00100000:0.0:1788839803.658570:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766592 00000100:00100000:0.0:1788839803.658601:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839803.658608:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17143:x1875734060766592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788839803.659014:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17143:x1875734060766592:12345-0@lo:502:llog_process_th.0 Request processed in 406us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839803.659022:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839803.659282:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17143:1875734060766592:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788839803.659426:0:17143:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788839803.659441:0:17143:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ab6479a4d28) 00000020:00000080:3.0:1788839803.659460:0:17143:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788839803.659547:0:17143:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab64817e800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788839803.659551:0:17143:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab64817e800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788839803.659554:0:17143:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab64817e800 4 00010000:00080000:3.0:1788839803.659583:0:17143:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab646523000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839803.662452:0:17143:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788839803.665128:0:17143:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788839803.665194:0:17143:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788839803.665208:0:17143:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xad5b343a26573cfd 00000100:00080000:3.0:1788839803.665220:0:17143:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839803.665225:0:17143:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab646523000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839803.665261:0:17143:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a49880 x1875734060766720/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839803.665301:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060766720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839803.667107:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839803.667194:0:17143:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788839803.667225:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766720 00000100:00100000:2.0:1788839803.667233:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766720 00000100:00100000:2.0:1788839803.667280:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788839803.667286:0:17114:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788839803.667289:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060766720:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788839803.667299:0:17114:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788839803.667365:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060766720:12345-0@lo:38:llog_process_th.0 Request processed in 76us (262us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788839803.667373:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839803.667413:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839803.667421:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646523000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839803.667426:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788839803.667430:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060766720:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839803.667651:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17143:1875734060766848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.667707:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.667732:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766848 00000100:00100000:3.0:1788839803.667735:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766848 00000100:00100000:3.0:1788839803.667766:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839803.667799:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17143:x1875734060766848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.667922:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17143:x1875734060766848:12345-0@lo:502:llog_process_th.0 Request processed in 123us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.667930:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839803.667993:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839803.668008:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17143:1875734060766848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.668045:0:17143:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17143:1875734060766976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.668078:0:17143:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.668101:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060766976 00000100:00100000:3.0:1788839803.668105:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060766976 00000100:00100000:3.0:1788839803.668129:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839803.668136:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17143:x1875734060766976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788839803.668206:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17143:x1875734060766976:12345-0@lo:502:llog_process_th.0 Request processed in 71us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.668213:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839803.668244:0:17143:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b61540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839803.668257:0:17143:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4b73860-6950-4a5d-8d03-52a643e5ff43:17143:1875734060766976:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788839803.668276:0:17143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788839803.669062:0:17092:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788839803.669090:0:17092:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788839803.669115:0:17092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839803.669128:0:17092:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552400/0xad5b343a26573ce8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573cef expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788839803.669181:0:17092:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788839803.669183:0:17092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788839803.669185:0:17092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839803.669186:0:17092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839803.669187:0:17092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839803.669188:0:17092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839803.669190:0:17092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839803.669191:0:17092:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788839803.669193:0:17092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839803.669194:0:17092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788839803.669198:0:17092:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788839803.669201:0:17092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788839803.669202:0:17092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788839803.669203:0:17092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839803.669205:0:17092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839803.669206:0:17092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839803.669207:0:17092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839803.669208:0:17092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839803.669209:0:17092:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788839803.669210:0:17092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839803.669211:0:17092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788839803.669228:0:17092:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788839803.669241:0:17092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060767104:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788839803.669283:0:17092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839803.669317:0:17092:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab647a9b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839803.672238:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767104 00000100:00100000:3.0:1788839803.672252:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767104 00000100:00100000:3.0:1788839803.672316:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839803.672337:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17092:x1875734060767104:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839803.672376:0:17107:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788839803.672393:0:17107:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788839803.674660:0:17107:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788839803.674672:0:17107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788839803.674833:0:17129:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839803.674839:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839803.674875:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.674896:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ccc expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.674905:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.674951:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573ccc expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.675001:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573ccc expref: 12 pid: 17108 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839803.675017:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060767232:0@lo:104: 00000100:00100000:2.0:1788839803.675087:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839803.675128:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839803.675572:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767232 00000100:00100000:3.0:1788839803.675580:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767232 00000100:00100000:3.0:1788839803.675629:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839803.675639:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060767232:12345-0@lo:104: 00010000:00010000:3.0:1788839803.675652:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.675711:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839803.675717:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060767232:12345-0@lo:104: Request processed in 81us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.675724:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788839803.675744:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839803.675749:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.675763:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839803.675766:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.675793:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839803.675800:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839803.675805:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839803.675833:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.675840:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839803.677256:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677270:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552a00/0xad5b343a26573ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573cd3 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677296:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839803.677298:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839803.677300:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839803.677459:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060767360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839803.677518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839803.677603:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767360 00000100:00100000:3.0:1788839803.677611:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767360 00010000:00010000:3.0:1788839803.677635:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ccc expref: 13 pid: 17108 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.677668:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839803.677675:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+13:3616:x1875734060767360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839803.677688:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839803.677693:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ccc expref: 13 pid: 17108 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677703:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573ccc expref: 13 pid: 17108 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677721:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677729:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788839803.677741:0:17098:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002903167s 00010000:00010000:3.0:1788839803.677745:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677752:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677758:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677765:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677786:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839803.677795:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677803:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677812:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839803.677822:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839803.677854:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+13:3616:x1875734060767360:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.677861:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788839803.678051:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959000/0xad5b343a26573cd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573ccc expref: 13 pid: 17108 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839803.678063:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060767232:0@lo:104: 00010000:00010000:2.0:1788839803.678083:0:17129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.678091:0:17129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.678097:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839803.678103:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842c00/0xad5b343a26573d04 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839803.678459:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060767360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839803.678528:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17092:x1875734060767104:12345-0@lo:253:mount.lustre.0 Request processed in 6204us (9245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839803.678537:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839803.678763:0:17092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17092:1875734060767104:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788839803.678825:0:17092:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788839803.678828:0:17092:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839803.678830:0:17092:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788839803.678832:0:17092:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839803.678833:0:17092:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839803.678835:0:17092:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839803.678837:0:17092:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839803.678840:0:17092:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839803.678842:0:17092:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788839803.678855:0:17092:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839803.678856:0:17092:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788839803.679293:0:17092:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1788839803.712566:0:17092:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788839803.715295:0:17092:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788839803.723073:0:17155:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788839803.723583:0:17092:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:2.0:1788839803.724110:0:17153:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788839803.724116:0:17153:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1788839803.724879:0:17155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788839803.727257:0:17156:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8ab7819fa300 x1875734060767488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839803.727272:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000040:01000000:3.0:1788839803.727691:0:17092:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788839803.727730:0:17092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788839803.730063:0:17092:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788839803.730084:0:17092:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788839803.731547:0:17092:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839803.733670:0:17155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788839803.733785:0:17155:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788839803.734684:0:17092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788839803.736684:0:17092:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788839803.736753:0:17092:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788839803.742025:0:17092:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1788839803.744610:0:17092:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788839803.749755:0:17092:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788839803.749824:0:17092:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6988158b988 00100000:10000000:1.0:1788839803.749832:0:17092:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788839803.751265:0:17092:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788839803.751282:0:17092:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788839803.751298:0:17092:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788839803.751313:0:17092:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788839803.754109:0:17092:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839803.754444:0:17092:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788839804.350997:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839804.735706:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000040:00080000:1.0:1788839804.741242:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788839805.056230:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788839805.056238:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab64817e800 from 7 10000000:01000000:0.0:1788839805.056243:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788839805.056288:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839805.056300:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839805.056310:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839805.056334:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060767616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839805.059111:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839805.059174:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839805.060657:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767616 00000100:00100000:2.0:1788839805.060670:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767616 00000100:00100000:2.0:1788839805.060727:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839805.060739:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+11:17110:x1875734060767616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839805.060757:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839805.060804:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573d0b expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839805.060834:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573d0b expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839805.060845:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573d0b expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839805.060854:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843800, rc 0) 00000100:00100000:2.0:1788839805.060915:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17110:x1875734060767616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839805.060921:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839805.061126:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060767616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839805.061144:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839805.061154:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839805.061217:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060767744:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788839805.061253:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839805.061291:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75190dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839805.061689:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767744 00000100:00100000:0.0:1788839805.061696:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767744 00000100:00100000:0.0:1788839805.061731:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788839805.061740:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17110:x1875734060767744:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788839805.061756:0:17108:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839805.061785:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839805.061789:0:17108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788839805.061868:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17110:x1875734060767744:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839805.061875:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839805.063002:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060767744:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839805.063056:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839805.063066:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839805.063087:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839805.374929:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839805.760001:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000040:00080000:2.0:1788839805.760807:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839806.403275:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839806.786412:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:1.0:1788839807.423014:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839807.810600:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000001:02000400:2.0:1788839807.879581:0:17398:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788839808.449584:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839808.832946:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000020:00000004:3.0:1788839808.871596:0:17451:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839808.872160:0:17451:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1788839808.897726:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839808.897741:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788839808.897745:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839808.897753:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:3.0:1788839808.897759:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788839808.897766:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab647a27800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839808.897811:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a4b100 x1875734060768000/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839808.897813:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788839808.897845:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788839808.897847:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060767872:0@lo:400:kworker.0 00000100:00080000:3.0:1788839808.897849:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839808.897854:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839808.897857:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839808.897861:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839808.897868:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788839808.897869:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646523000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839808.897875:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab646523000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839808.897889:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a4b800 x1875734060768128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839808.897931:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839808.898124:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768000:0@lo:38:kworker.0 00000100:00100000:2.0:1788839808.898165:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839808.898182:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060768128:0@lo:38:kworker.0 00000100:00100000:2.0:1788839808.898216:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839808.898380:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767872 00000100:00100000:3.0:1788839808.898388:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767872 00000100:00100000:3.0:1788839808.898433:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839808.898441:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:3616:x1875734060767872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839808.898483:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:3616:x1875734060767872:12345-0@lo:400:kworker.0 Request processed in 43us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839808.898490:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788839808.898568:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060768000 00000100:00100000:0.0:1788839808.898571:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060768000 00000100:00100000:0.0:1788839808.898595:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839808.898600:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060768000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788839808.898614:0:17119:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788839808.901368:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060767872:0@lo:400:kworker.0 00000100:00100000:1.0:1788839808.902000:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060768128 00000100:00100000:1.0:1788839808.902009:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060768128 00000100:00100000:1.0:1788839808.902049:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788839808.902056:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060768128:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788839808.902242:0:17115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1788839808.902300:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xad5b343a26573d19 00000004:00100000:1.0:1788839808.902317:0:17115:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788839808.902450:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8ab647a24800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839808.904330:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875734060768128:12345-0@lo:38:kworker.0 Request processed in 2265us (6105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839808.904344:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788839808.915048:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab781a4b800 x1875734060768128/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788839808.915246:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788839808.915255:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788839808.915261:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788839808.915265:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646523000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788839808.915273:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875734060768128:0@lo:38:kworker.0 00000100:00100000:0.0:1788839808.929627:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060768000:12345-0@lo:38:kworker.0 Request processed in 31020us (31454us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788839808.929641:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788839808.938124:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788839808.938148:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788839808.938153:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768000:0@lo:38:kworker.0 00010000:00010000:1.0:1788839809.472890:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839809.854858:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000020:00000004:2.0:1788839809.859635:0:17501:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839809.860054:0:17501:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788839810.503173:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839810.882857:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:0.0:1788839811.522102:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839811.902905:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:2.0:1788839812.543001:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839812.932225:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:0.0:1788839813.573281:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839813.950864:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000100:00080000:3.0:1788839814.014977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839814.014984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788839814.014987:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839814.014995:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 463 00000100:00080000:3.0:1788839814.015000:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788839814.015005:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab647a27800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839814.015027:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a49f80 x1875734060768384/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839814.015055:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839814.015059:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839814.015062:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839814.015065:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839814.015492:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060768512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839814.015558:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839814.015620:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839814.015627:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060768256:0@lo:400:kworker.0 00000100:00100000:3.0:1788839814.015658:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839814.015712:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060768512 00000100:00100000:3.0:1788839814.015718:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060768512 00000100:00100000:3.0:1788839814.015763:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839814.015790:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060768512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839814.015882:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875734060768512:12345-0@lo:400:kworker.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839814.015888:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788839814.020794:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab781a4bb80 x1875734060768512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839814.020811:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875734060768512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839814.022352:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060768256 00000100:00100000:3.0:1788839814.022363:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060768256 00000100:00100000:0.0:1788839814.022545:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839803/real 1788839803] req@ffff8ab781a48e00 x1875734060765056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839814.022573:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab781a48e00 x1875734060765056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839813 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839814.022584:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839814.022586:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839803/real 1788839803] req@ffff8ab647bb6680 x1875734060764928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839813 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839814.022597:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:3615:x1875734060768256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839814.022602:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab647bb6680 x1875734060764928/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839813 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839814.022623:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768384:0@lo:38:kworker.0 00000100:00100000:3.0:1788839814.022684:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:3615:x1875734060768256:12345-0@lo:400:kworker.0 Request processed in 90us (7025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839814.022691:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788839814.022721:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839814.022738:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060768256:0@lo:400:kworker.0 00000100:00100000:3.0:1788839814.022786:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060768384 00000100:00100000:3.0:1788839814.022790:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060768384 00000100:00080000:0.0:1788839814.022793:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839814.022810:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788839814.022813:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839814.022818:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060768384:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788839814.022826:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060765056:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788839814.022832:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839814.022838:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788839814.022842:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060764928:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788839814.022884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839814.022889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788839814.022891:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839814.022895:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:0.0:1788839814.022899:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839814.022904:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab646534800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839814.022937:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777caa300 x1875734060768640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839814.022953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839814.022956:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788839814.022958:0:37:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839814.022961:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 458 00000100:00080000:0.0:1788839814.022963:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839814.022966:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab647a27000 using connection 192.168.203.152@tcp/0@lo 00010000:00020000:3.0:1788839814.022975:0:17118:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788839814.022979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777cabb80 x1875734060768768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839814.023006:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768640:0@lo:8:kworker.0 00000400:00000100:0.0:1788839814.023050:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060768640 offset 0 length 520: 4 00000100:00100000:0.0:1788839814.023069:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768768:0@lo:8:kworker.0 00000400:00000100:0.0:1788839814.023097:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060768768 offset 0 length 520: 4 00000100:00100000:3.0:1788839814.054704:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875734060768384:12345-0@lo:38:kworker.0 Request processed in 31876us (31977us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788839814.054719:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788839814.055325:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839814.055332:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788839814.055337:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768384:0@lo:38:kworker.0 00010000:00010000:0.0:1788839814.590942:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839814.976115:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:1.0:1788839815.620586:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839815.998945:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000040:00080000:1.0:1788839816.000342:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839816.640025:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839817.035805:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000020:01000004:2.0:1788839817.259040:0:17846:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788839817.259044:0:17846:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788839817.259046:0:17846:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788839817.259162:0:17846:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab7479d8000 00000020:01000004:2.0:1788839817.259177:0:17846:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788839817.259189:0:17846:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788839817.259202:0:17846:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8ab777fb0000) 00000020:00000080:2.0:1788839817.259219:0:17846:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839817.303755:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788839817.306288:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.307134:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788839817.307529:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788839817.307730:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788839817.308202:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788839817.308391:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788839817.308670:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788839817.309005:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788839817.309172:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788839817.309358:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788839817.309594:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788839817.310001:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788839817.310167:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788839817.310611:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.311195:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.311392:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.311674:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.312059:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.312357:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.312616:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.313004:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.313208:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.313399:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.313675:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788839817.314037:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.314254:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.314506:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.315062:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.315262:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.315565:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788839817.315743:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.316384:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788839817.316664:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.316989:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.317151:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788839817.317317:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788839817.317557:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788839817.317933:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.318141:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788839817.318335:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.318577:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.318991:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.319182:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788839817.319365:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788839817.319637:0:17846:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:3.0:1788839817.322612:0:17846:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788839817.323111:0:17846:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788839817.323125:0:17846:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839817.323139:0:17846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26573d27 00000020:01000004:3.0:1788839817.323147:0:17846:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788839817.323170:0:17846:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788839817.323174:0:17846:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788839817.323179:0:17846:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788839817.323225:0:17846:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788839817.323230:0:17846:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788839817.329619:0:17846:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788839817.329663:0:17846:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788839817.329668:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788839817.329670:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839817.329671:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839817.329672:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839817.329673:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839817.329674:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839817.329675:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839817.329677:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839817.329678:0:17846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839817.329681:0:17846:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788839817.329683:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839817.329685:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839817.329691:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839817.329691:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839817.329692:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839817.329693:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839817.329694:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839817.329695:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839817.329696:0:17846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788839817.329725:0:17846:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788839817.330056:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060768896:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839817.330130:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.330247:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.330322:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060768896 00000100:00100000:2.0:1788839817.330330:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060768896 00000100:00100000:2.0:1788839817.330408:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839817.330418:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17846:x1875734060768896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788839817.330476:0:17105:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788839817.330479:0:17105:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788839817.330488:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788839817.331049:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17846:x1875734060768896:12345-0@lo:253:mount.lustre.0 Request processed in 630us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.331057:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839817.331141:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060768896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788839817.331153:0:17846:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788839817.331156:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839817.331157:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788839817.331159:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839817.331160:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839817.331161:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839817.331163:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839817.331164:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839817.331165:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839817.331167:0:17846:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788839817.331187:0:17846:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab7479d8000 from lustre-MDT0001 10000000:01000000:0.0:1788839817.331228:0:17846:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788839817.331231:0:17846:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788839817.331238:0:17846:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab777fb4d28 local copy 00010000:00010000:0.0:1788839817.331248:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839817.331351:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839817.331383:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.332014:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.332117:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769024 00000100:00100000:3.0:1788839817.332124:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769024 00000100:00100000:3.0:1788839817.332158:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788839817.332166:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17846:x1875734060769024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839817.332233:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17846:x1875734060769024:12345-0@lo:501:mount.lustre.0 Request processed in 68us (849us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788839817.332240:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788839817.332309:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769024:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788839817.332327:0:17846:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788839817.332353:0:17846:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788839817.332360:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.332371:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839817.332394:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab7479d8000 10000000:01000000:0.0:1788839817.332398:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788839817.332403:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab777fb4d28 10000000:01000000:0.0:1788839817.332406:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788839817.332409:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8ab777fb4d28 from 1 10000000:01000000:0.0:1788839817.332412:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788839817.332444:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.332453:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.332461:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839817.332475:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839817.332501:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.332551:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.332650:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769152 00000100:00100000:3.0:1788839817.332654:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769152 00000100:00100000:3.0:1788839817.332670:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839817.332675:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+12:17846:x1875734060769152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839817.332684:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839817.332696:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552600/0xad5b343a26573d35 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573d2e expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.332713:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552600/0xad5b343a26573d35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573d2e expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.332722:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552600/0xad5b343a26573d35 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573d2e expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.332740:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552600, rc 0) 00000100:00100000:3.0:1788839817.333034:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+13:17846:x1875734060769152:12345-0@lo:101:mount.lustre.0 Request processed in 357us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.333040:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788839817.333102:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839817.333114:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.333123:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839817.333143:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788839817.333189:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.333197:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647bfcc00/0xad5b343a26573d2e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d35 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839817.333205:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab7479d8000 10000000:01000000:0.0:1788839817.333209:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788839817.333212:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8ab7479d8000 from 1 10000000:01000000:0.0:1788839817.333214:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788839817.333228:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.333235:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.333242:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839817.333254:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839817.333277:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.333302:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.333346:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769280 00000100:00100000:3.0:1788839817.333351:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769280 00000100:00100000:3.0:1788839817.333381:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788839817.333387:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+13:17846:x1875734060769280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839817.333395:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839817.333403:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552a00/0xad5b343a26573d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573d3c expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.333416:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552a00/0xad5b343a26573d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573d3c expref: 14 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.333424:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552a00/0xad5b343a26573d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573d3c expref: 14 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.333431:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552a00, rc 0) 00000100:00100000:3.0:1788839817.333582:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+14:17846:x1875734060769280:12345-0@lo:101:mount.lustre.0 Request processed in 194us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.333588:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788839817.333653:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839817.333662:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.333670:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839817.333689:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788839817.334237:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.334247:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647bfde00/0xad5b343a26573d3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d43 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839817.334255:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788839817.334260:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788839817.334265:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab7479d8000 10000000:01000000:0.0:1788839817.334268:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788839817.334272:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788839817.334274:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788839817.334292:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.334298:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.334307:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839817.334322:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839817.334353:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.334384:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839817.334450:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769408 00000100:00100000:1.0:1788839817.334455:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769408 00000100:00100000:1.0:1788839817.334494:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788839817.334502:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+14:17846:x1875734060769408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839817.334513:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839817.334523:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647958400/0xad5b343a26573d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573d4a expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.334538:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958400/0xad5b343a26573d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573d4a expref: 15 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.334547:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647958400/0xad5b343a26573d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573d4a expref: 15 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.334553:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958400, rc 0) 00000100:00100000:1.0:1788839817.334586:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769408:12345-0@lo:101:mount.lustre.0 Request processed in 85us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.334592:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788839817.334725:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839817.334737:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.334766:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839817.336298:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788839817.337116:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839817.342407:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788839817.342537:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788839817.342553:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788839817.342564:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788839817.342575:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788839817.342586:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788839817.342597:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788839817.342607:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788839817.342618:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788839817.342628:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788839817.342639:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788839817.342650:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788839817.342661:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788839817.342671:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788839817.342682:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788839817.342692:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788839817.342703:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788839817.342713:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788839817.342723:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788839817.342734:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788839817.342744:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788839817.343279:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788839817.343290:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788839817.343316:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788839817.343320:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788839817.343428:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839817.343510:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.343604:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788839817.343646:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769536 00000100:00100000:1.0:1788839817.343654:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769536 00000100:00100000:1.0:1788839817.343722:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839817.343731:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839817.344008:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769536:12345-0@lo:501:mount.lustre.0 Request processed in 278us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.344016:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788839817.344116:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839817.344157:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839817.344200:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.344594:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab778bb4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839817.344663:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769664 00000100:00100000:0.0:1788839817.344669:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769664 00000100:00100000:0.0:1788839817.344698:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839817.344705:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839817.345529:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769664:12345-0@lo:503:mount.lustre.0 Request processed in 821us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839817.345538:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788839817.345646:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769664:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788839817.346461:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839817.346553:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839817.346606:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.346652:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.347329:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769792 00000100:00100000:2.0:1788839817.347338:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769792 00000100:00100000:2.0:1788839817.347376:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788839817.347385:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839817.348391:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769792:12345-0@lo:502:mount.lustre.0 Request processed in 1004us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.348401:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839817.348498:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839817.348718:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788839817.348762:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788839817.348809:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788839817.348835:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788839817.348848:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788839817.348860:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788839817.348872:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788839817.349067:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788839817.349086:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788839817.349100:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788839817.349112:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788839817.349126:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788839817.349139:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788839817.349153:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788839817.349179:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788839817.349210:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788839817.349227:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788839817.349240:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788839817.349254:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788839817.349268:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788839817.349281:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788839817.349294:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788839817.349307:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788839817.349321:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788839817.349332:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788839817.349345:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788839817.349357:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788839817.349371:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788839817.349382:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788839817.349395:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788839817.349407:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788839817.349433:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788839817.349447:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788839817.349458:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788839817.349469:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788839817.349481:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788839817.349493:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788839817.349505:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788839817.349517:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788839817.349529:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788839817.349541:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788839817.349552:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788839817.349562:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788839817.349572:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788839817.349608:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839817.349663:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.349703:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.349798:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060769920 00000100:00100000:2.0:1788839817.349805:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060769920 00000100:00100000:2.0:1788839817.349845:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788839817.349853:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769920:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839817.350123:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060769920:12345-0@lo:502:mount.lustre.0 Request processed in 271us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.350130:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788839817.351011:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060769920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839817.351080:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788839817.351090:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788839817.352260:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839817.352272:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839817.352274:0:17850:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788839817.352279:0:17850:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788839817.352282:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839817.352295:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8ab7486ecd28) 00000020:00000080:1.0:1788839817.352314:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1788839817.352318:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788839817.352383:0:17850:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788839817.352388:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26573d5f 00000020:00000080:1.0:1788839817.352567:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788839817.352571:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839817.352574:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839817.352575:0:17850:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788839817.352578:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839817.352581:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839817.352582:0:17850:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788839817.352584:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788839817.352591:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8ab7486e99b8) 00000020:00000080:1.0:1788839817.352600:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1788839817.352603:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788839817.352605:0:17850:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788839817.352607:0:17850:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788839817.352612:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788839817.352652:0:17850:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7479d8000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788839817.352665:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8ab77e4fb370) 00000020:00000080:1.0:1788839817.352675:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1788839817.354166:0:17850:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788839817.354180:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573d74 00000020:00000080:1.0:1788839817.354326:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788839817.354334:0:17850:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788839817.354339:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xad5b343a26573d7b 00080000:01000000:1.0:1788839817.354346:0:17850:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788839817.354361:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26573d82 00010000:00010000:3.0:1788839817.490055:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788839817.493834:0:17850:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788839817.496815:0:17850:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788839817.501060:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788839817.501074:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.501081:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.501084:0:17850:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788839817.501087:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839817.501092:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.501093:0:17850:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788839817.501096:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788839817.501102:0:17850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:00000080:2.0:1788839817.501127:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839817.501142:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8ab777fb19b8) 00000020:00000080:2.0:1788839817.501162:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788839817.501167:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788839817.501255:0:17850:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788839817.501262:0:17850:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788839817.501271:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26573d90 00010000:00080000:2.0:1788839817.501322:0:17850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab77e444800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839817.515121:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788839817.516652:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839817.516665:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788839817.516699:0:17850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788839817.516719:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573d97 00000100:00080000:2.0:1788839817.516729:0:17850:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839817.516735:0:17850:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8ab77e444800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839817.517019:0:17850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f8700 x1875734060770048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839817.517046:0:17850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788839817.517090:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.517101:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.517103:0:17850:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788839817.517107:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788839817.517109:0:17850:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788839817.517111:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839817.517112:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839817.517114:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788839817.517116:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.517118:0:17850:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788839817.517120:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839817.517125:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.517127:0:17850:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788839817.517131:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788839817.517162:0:17850:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788839817.517174:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.517176:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.517178:0:17850:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788839817.517180:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788839817.517181:0:17850:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788839817.517182:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839817.517184:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788839817.517185:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788839817.517187:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.517188:0:17850:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788839817.517190:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788839817.517193:0:17850:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788839817.517196:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.517197:0:17850:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788839817.517200:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788839817.517204:0:17850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1788839817.517227:0:17850:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788839817.517229:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788839817.517243:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8ab7487d4d28) 00000020:00000080:2.0:1788839817.517255:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788839817.517264:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:3.0:1788839817.517401:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788839817.517406:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788839817.517409:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839817.517421:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:3.0:1788839817.517425:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788839817.517429:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab647a27800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839817.517447:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a4bb80 x1875734060770176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839817.517456:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839817.517459:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839817.517462:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839817.517464:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839817.517507:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060770304:0@lo:400:kworker.0 00000100:00100000:3.0:1788839817.517570:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.517633:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060770304 00000100:00100000:3.0:1788839817.517640:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060770304 00000100:00100000:3.0:1788839817.517679:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839817.517687:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060770304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839817.517747:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060770304:12345-0@lo:400:kworker.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.517754:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788839817.517811:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab781a48a80 x1875734060770304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839817.517823:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060770304:0@lo:400:kworker.0 00000100:00100000:0.0:1788839817.517987:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060770048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839817.518023:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.518058:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060770176:0@lo:38:kworker.0 00000100:00100000:0.0:1788839817.518079:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788839817.518174:0:17850:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788839817.518180:0:17850:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788839817.518186:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26573da5 00010000:00080000:2.0:1788839817.518211:0:17850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab648168000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839817.519546:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788839817.523024:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060770048 00000100:00100000:3.0:1788839817.523039:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060770048 00000100:00100000:3.0:1788839817.523066:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060770176 00000100:00100000:3.0:1788839817.523075:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060770176 00000100:00100000:3.0:1788839817.523094:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839817.523101:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060770048:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788839817.523127:0:17119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:3.0:1788839817.523162:0:17119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573dac 00000004:00100000:3.0:1788839817.523178:0:17119:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788839817.523183:0:17119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:2.0:1788839817.523432:0:17850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788839817.524013:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788839817.531866:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839817.532169:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788839817.532345:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00080000:1.0:1788839817.533130:0:17119:0:(import.c:65:import_set_state_nolock()) ffff8ab753b7d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839817.533237:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060770048:12345-0@lo:38:llog_process_th.0 Request processed in 10133us (15210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.533254:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839817.533284:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839817.533291:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060770176:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788839817.533342:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060770176:12345-0@lo:38:kworker.0 Request processed in 50us (15261us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788839817.533348:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1788839817.533412:0:17855:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788839817.533416:0:17855:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788839817.533657:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839817.533668:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788839817.533677:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788839817.533683:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788839817.533686:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab77e444800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788839817.533704:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060770048:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788839817.533719:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839817.533724:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839817.533727:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788839817.533730:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060770176:0@lo:38:kworker.0 00000100:00100000:3.0:1788839817.534133:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839817.534146:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060770432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839817.534203:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.534239:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060770432 00000100:00100000:3.0:1788839817.534245:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060770432 00000100:00100000:3.0:1788839817.534282:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839817.534290:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060770432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839817.535470:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788839817.535551:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060770432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1260us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.535561:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839817.535617:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060770432:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1788839817.538479:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788839817.538493:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788839817.538543:0:17850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788839817.538563:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573db3 00000100:00080000:3.0:1788839817.538572:0:17850:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788839817.538589:0:17850:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab648168000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839817.538624:0:17850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab781a48a80 x1875734060770560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788839817.538654:0:17850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788839817.538714:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839817.538718:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839817.538720:0:17850:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788839817.538723:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788839817.538726:0:17850:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788839817.538727:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839817.538729:0:17850:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839817.538730:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788839817.538733:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839817.538734:0:17850:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788839817.538736:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839817.538740:0:17850:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788839817.538743:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839817.538744:0:17850:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788839817.538746:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788839817.538750:0:17850:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1788839817.538805:0:17850:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788839817.538808:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839817.538819:0:17850:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8ab6479a0000) 00000020:00000080:3.0:1788839817.538831:0:17850:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788839817.538836:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00080000:1.0:1788839817.538984:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839817.538988:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839817.538991:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839817.538993:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839817.539061:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060770560:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788839817.539111:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060770560 offset 0 length 520: 4 00000004:00080000:3.0:1788839817.539197:0:17850:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788839817.539204:0:17850:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788839817.539210:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xad5b343a26573dc1 00010000:00080000:3.0:1788839817.539239:0:17850:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab646b66800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1788839817.539445:0:17850:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788839817.539510:0:17850:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788839817.539530:0:17850:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788839817.542951:0:17850:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839817.543248:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788839817.543373:0:17850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788839817.543819:0:17857:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788839817.543824:0:17857:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788839817.544528:0:17850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788839817.544540:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788839817.544580:0:17850:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788839817.544601:0:17850:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573dc8 00000100:00080000:2.0:1788839817.544611:0:17850:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839817.544616:0:17850:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab646b66800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839817.544652:0:17850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f8700 x1875734060770688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839817.544688:0:17850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788839817.544792:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060770688:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788839817.544847:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060770688 offset 0 length 520: 4 00000020:01000000:2.0:1788839817.545136:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.545141:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.545143:0:17850:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788839817.545146:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839817.545150:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.545151:0:17850:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839817.545154:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839817.545156:0:17850:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788839817.545158:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.545160:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.545161:0:17850:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788839817.545163:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839817.545166:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.545167:0:17850:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839817.545171:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788839817.545198:0:17850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.545201:0:17850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.545202:0:17850:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839817.545205:0:17850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788839817.545256:0:17846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788839817.545285:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788839817.545366:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545379:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647bfc600/0xad5b343a26573d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573d51 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839817.545389:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7479d8000 from 1 10000000:01000000:2.0:1788839817.545391:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788839817.545417:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545432:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545443:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839817.545461:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060770816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839817.545502:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.545521:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74674fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.545545:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060770816 00000100:00100000:2.0:1788839817.545551:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060770816 00000100:00100000:2.0:1788839817.545588:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839817.545596:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+15:17846:x1875734060770816:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839817.545609:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839817.545620:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573dcf expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545640:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573dcf expref: 16 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545650:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573dcf expref: 16 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545658:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842e00, rc 0) 00000100:00100000:2.0:1788839817.545693:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17846:x1875734060770816:12345-0@lo:101:mount.lustre.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.545699:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788839817.545754:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060770816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839817.545768:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.545795:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839817.546539:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060770944:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788839817.546578:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.546639:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74674fcc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788839817.548534:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839817.548544:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839817.548547:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839817.548550:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839817.548696:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060770944 00000100:00100000:3.0:1788839817.548707:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060770944 00000100:00100000:2.0:1788839817.548854:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839817.548865:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17846:x1875734060770944:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788839817.549048:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788839817.549093:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788839817.549097:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788839817.549231:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17846:x1875734060770944:12345-0@lo:256:mount.lustre.0 Request processed in 368us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.549239:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839817.549682:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060770944:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788839817.550442:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839817.550463:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.550476:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839817.550485:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7479d8000 from 1 10000000:01000000:3.0:1788839817.550488:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839817.550523:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.550532:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.550541:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839817.550563:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771072:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839817.550614:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.552064:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6469c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839817.555541:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771072 00000100:00100000:1.0:1788839817.555555:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771072 00000100:00100000:1.0:1788839817.555618:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839817.555639:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17846:x1875734060771072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839817.555656:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839817.555672:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573ddd expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.555699:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573ddd expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.555710:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ddd expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.555720:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959400, rc 0) 00000100:00100000:1.0:1788839817.556079:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771072:12345-0@lo:101:mount.lustre.0 Request processed in 440us (5463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.556085:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788839817.556176:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839817.556195:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.556203:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839817.556665:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839817.556707:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771200:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839817.556744:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.556805:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.556871:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771200 00000100:00100000:2.0:1788839817.556887:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771200 00000100:00100000:2.0:1788839817.556931:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788839817.556938:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771200:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839817.557033:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771200:12345-0@lo:501:mount.lustre.0 Request processed in 95us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.557039:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788839817.557225:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839817.557257:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839817.557308:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.557332:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788839817.557434:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771328 00000100:00100000:1.0:1788839817.557439:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771328 00000100:00100000:1.0:1788839817.557470:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839817.557476:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771328:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839817.557555:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771328:12345-0@lo:503:mount.lustre.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.557561:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788839817.557637:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771328:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788839817.558018:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839817.558090:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771456:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839817.558125:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.558203:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.558562:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771456 00000100:00100000:3.0:1788839817.558569:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771456 00000100:00100000:3.0:1788839817.558605:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788839817.558612:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771456:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839817.558699:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771456:12345-0@lo:502:mount.lustre.0 Request processed in 87us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.558706:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839817.558913:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839817.559078:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788839817.559101:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788839817.559113:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788839817.559126:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788839817.559139:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788839817.559151:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788839817.559162:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788839817.559173:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788839817.559196:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788839817.559208:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788839817.559218:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788839817.559241:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839817.559276:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.559486:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab759f7f300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.559542:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771584 00000100:00100000:3.0:1788839817.559548:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771584 00000100:00100000:3.0:1788839817.559580:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788839817.559586:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839817.559666:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771584:12345-0@lo:502:mount.lustre.0 Request processed in 79us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.559673:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788839817.559801:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788839817.559845:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788839817.559854:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788839817.560590:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839817.560602:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839817.560605:0:17859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788839817.560611:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab7479d8000 00000020:00000080:0.0:1788839817.560614:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839817.560623:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839817.560626:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839817.560628:0:17859:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788839817.560630:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839817.560633:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839817.560634:0:17859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788839817.560637:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab7479d8000 00000020:00000080:0.0:1788839817.560640:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839817.560734:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788839817.560738:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839817.560740:0:17859:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788839817.560742:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788839817.560745:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788839817.560747:0:17859:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788839817.560750:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab7479d8000 00000020:00000080:0.0:1788839817.560753:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788839817.562502:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.562600:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.562604:0:17859:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788839817.562613:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839817.562617:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.562618:0:17859:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788839817.562623:0:17859:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab7479d8000 00000020:00000080:2.0:1788839817.562626:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788839817.562682:0:17859:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839817.562685:0:17859:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839817.562687:0:17859:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788839817.562690:0:17859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788839817.569451:0:17846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788839817.569510:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788839817.569540:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.569554:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839817.570275:0:17846:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788839817.570280:0:17846:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab7479d8000 10000000:01000000:3.0:1788839817.570283:0:17846:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab7479d8000 10000000:01000000:3.0:1788839817.570286:0:17846:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788839817.570293:0:17846:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab7479d8000 from 1 10000000:01000000:3.0:1788839817.572012:0:17846:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788839817.572059:0:17846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.572071:0:17846:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.572081:0:17846:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839817.572105:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839817.572171:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.572222:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771712 00000100:00100000:3.0:1788839817.572229:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771712 00000100:00100000:3.0:1788839817.572276:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839817.572284:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17846:x1875734060771712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839817.572310:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839817.572324:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553400/0xad5b343a26573df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573deb expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.572360:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553400/0xad5b343a26573df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573deb expref: 18 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.572370:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553400/0xad5b343a26573df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573deb expref: 18 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.572379:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553400, rc 0) 00000100:00100000:3.0:1788839817.572413:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060771712:12345-0@lo:101:mount.lustre.0 Request processed in 129us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.572419:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788839817.572464:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.572485:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771712:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839817.572499:0:17846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.572507:0:17846:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839817.602381:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788839817.602745:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839817.604805:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788839817.604861:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788839817.606108:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788839817.606146:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788839817.606162:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788839817.606177:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788839817.606192:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788839817.606211:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788839817.606225:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788839817.606242:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788839817.606256:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788839817.606269:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788839817.606284:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788839817.606309:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788839817.606326:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788839817.606340:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788839817.606352:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788839817.606364:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788839817.606376:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788839817.606391:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788839817.606404:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788839817.606417:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788839817.606443:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788839817.606460:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788839817.606474:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788839817.606490:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788839817.606505:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788839817.606537:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788839817.606565:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788839817.606570:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788839817.606680:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839817.606747:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.606818:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839817.608071:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771840 00000100:00100000:0.0:1788839817.608083:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771840 00000100:00100000:0.0:1788839817.608137:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788839817.608147:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060771840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839817.608328:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060771840:12345-0@lo:501:mount.lustre.0 Request processed in 182us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839817.608336:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788839817.609362:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839817.609414:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771968:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839817.609469:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.609540:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.622599:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060771968 00000100:00100000:3.0:1788839817.622611:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060771968 00000100:00100000:2.0:1788839817.622764:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788839817.623198:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060771968:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839817.623400:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060771968:12345-0@lo:503:mount.lustre.0 Request processed in 217us (13931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.623469:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060771968:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788839817.623958:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839817.624036:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839817.624088:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.624118:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.624135:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772096 00000100:00100000:3.0:1788839817.624146:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772096 00000100:00100000:2.0:1788839817.625995:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788839817.626134:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788839817.626149:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839817.626307:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772096:12345-0@lo:502:mount.lustre.0 Request processed in 163us (2218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.626314:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788839817.626384:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839817.626609:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788839817.626636:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788839817.626648:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788839817.626660:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788839817.626673:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788839817.626687:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788839817.626710:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788839817.626724:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788839817.626737:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788839817.626749:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788839817.626761:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788839817.626800:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788839817.626820:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788839817.626835:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788839817.626847:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788839817.626858:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788839817.626870:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788839817.627810:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788839817.627833:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788839817.627848:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788839817.627863:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788839817.627954:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788839817.627990:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788839817.628007:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788839817.628023:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788839817.628036:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788839817.628047:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788839817.628057:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788839817.628068:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788839817.628079:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788839817.628089:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788839817.628099:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788839817.628109:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788839817.628120:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788839817.628130:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788839817.628140:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788839817.628151:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788839817.628161:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788839817.628183:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788839817.628200:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788839817.628211:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788839817.628221:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788839817.628231:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788839817.628242:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788839817.628253:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788839817.628263:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788839817.628273:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788839817.628284:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788839817.628331:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772224:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839817.628394:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.630590:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788839817.630633:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772224 00000100:00100000:1.0:1788839817.630642:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772224 00000100:00100000:1.0:1788839817.630687:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839817.630696:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839817.630900:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772224:12345-0@lo:502:mount.lustre.0 Request processed in 197us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.630916:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788839817.631237:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839817.631513:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788839817.631538:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788839817.631569:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772352:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839817.631610:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.631674:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.631690:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772352 00000100:00100000:2.0:1788839817.631694:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772352 00000100:00100000:1.0:1788839817.633249:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839817.633265:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839817.633680:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772352:12345-0@lo:502:mount.lustre.0 Request processed in 420us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.633688:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788839817.633861:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839817.634085:0:17846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788839817.634097:0:17846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788839817.640292:0:17866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788839817.640321:0:17866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8ab7487d19b8) 00000020:00000080:2.0:1788839817.640345:0:17866:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788839817.640421:0:17866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab7479d8000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788839817.640425:0:17866:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab7479d8000 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788839817.640428:0:17866:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab7479d8000 3 00010000:00080000:2.0:1788839817.640459:0:17866:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab745344000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839817.644338:0:17866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788839817.644554:0:17866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788839817.644604:0:17866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839817.644617:0:17866:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xad5b343a26573e00 00000100:00080000:2.0:1788839817.644628:0:17866:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839817.644634:0:17866:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8ab745344000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839817.644671:0:17866:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819f9880 x1875734060772480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839817.644728:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060772480:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788839817.644823:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839817.645147:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772480 00000100:00100000:1.0:1788839817.645155:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772480 00000100:00100000:1.0:1788839817.645192:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788839817.645199:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060772480:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788839817.645222:0:17114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1788839817.645275:0:17114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xad5b343a26573e07 00000004:00100000:1.0:1788839817.645290:0:17114:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788839817.645333:0:17114:0:(import.c:65:import_set_state_nolock()) ffff8ab75e470800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839817.645384:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875734060772480:12345-0@lo:38:llog_process_th.0 Request processed in 184us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839817.645391:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788839817.645998:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab7819f9880 x1875734060772480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839817.646009:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839817.646017:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788839817.646024:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788839817.646028:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788839817.646030:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab745344000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788839817.646035:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875734060772480:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788839817.646061:0:17866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839817.648808:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839817.648817:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839817.648820:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839817.648823:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788839817.650356:0:17866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:3.0:1788839817.652074:0:17846:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788839817.652111:0:17846:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788839817.652129:0:17846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.652141:0:17846:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552200/0xad5b343a26573deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573df2 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788839817.652185:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788839817.652187:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839817.652188:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839817.652189:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839817.652190:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839817.652192:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839817.652193:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839817.652195:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839817.652196:0:17846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788839817.652200:0:17846:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788839817.652202:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788839817.652203:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788839817.652204:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839817.652205:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839817.652206:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839817.652211:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839817.652212:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788839817.652213:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839817.652214:0:17846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788839817.652239:0:17846:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788839817.652257:0:17846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772608:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788839817.652329:0:17846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.652363:0:17846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764b840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.652398:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772608 00000100:00100000:3.0:1788839817.652405:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772608 00000100:00100000:3.0:1788839817.652451:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788839817.652459:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17846:x1875734060772608:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839817.652483:0:17105:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788839817.652495:0:17105:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:2.0:1788839817.662153:0:17093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788839817.662212:0:17105:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788839817.662221:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788839817.662284:0:17129:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788839817.662289:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788839817.662324:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662345:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573d0b expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662374:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573dcf expref: 18 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662382:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662421:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573dcf expref: 18 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662437:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573dcf expref: 18 pid: 17107 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839817.662453:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060772736:0@lo:104: 00000100:00100000:2.0:1788839817.662523:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788839817.662570:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573d0b expref: 18 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662578:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573d0b expref: 18 pid: 17105 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839817.662585:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060772864:0@lo:104: 00000100:00100000:2.0:1788839817.662606:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.662623:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.662661:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772736 00000100:00100000:2.0:1788839817.662667:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772736 00000100:00100000:2.0:1788839817.662698:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772864 00000100:00100000:2.0:1788839817.662700:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772864 00000100:00100000:2.0:1788839817.662715:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839817.662722:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:17129:x1875734060772736:12345-0@lo:104: 00010000:00010000:2.0:1788839817.662742:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839817.662816:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788839817.662823:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:17129:x1875734060772736:12345-0@lo:104: Request processed in 101us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.662830:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839817.662847:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839817.662853:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060772864:12345-0@lo:104: 00010000:00010000:2.0:1788839817.662860:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663020:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839817.663029:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663036:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839817.663041:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663049:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839817.663056:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839817.663062:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839817.663090:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663106:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839817.663127:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663133:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647843400/0xad5b343a26573dcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573dd6 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663148:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839817.663149:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839817.663151:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839817.663169:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839817.663181:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060772992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839817.663214:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.663245:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060772992 00000100:00100000:3.0:1788839817.663249:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060772992 00010000:00010000:3.0:1788839817.663269:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573dcf expref: 19 pid: 17107 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839817.663288:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839817.663294:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:3615:x1875734060772992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839817.663305:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839817.663309:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573dcf expref: 19 pid: 17107 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663318:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573dcf expref: 19 pid: 17107 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839817.663332:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839817.663366:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:3615:x1875734060772992:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.663372:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839817.663409:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060772992:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839817.665276:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839817.666037:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842e00/0xad5b343a26573dd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573dcf expref: 18 pid: 17107 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839817.666068:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060772736:0@lo:104: 00010000:00010000:3.0:1788839817.670857:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1788839817.671045:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839817.671056:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671068:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839817.671072:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671082:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839817.671090:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839817.671095:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788839817.671139:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671146:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839817.671169:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671187:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd600/0xad5b343a26573d0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573d12 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671203:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839817.671205:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839817.671207:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839817.671235:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060773120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839817.671307:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839817.671365:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773120 00000100:00100000:0.0:1788839817.671371:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773120 00010000:00010000:0.0:1788839817.671397:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573d0b expref: 18 pid: 17105 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839817.671424:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839817.671433:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3615:x1875734060773120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839817.671444:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839817.671450:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573d0b expref: 18 pid: 17105 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671460:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573d0b expref: 18 pid: 17105 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671477:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671485:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839817.671498:0:17100:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009209594s 00010000:00010000:0.0:1788839817.671507:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671514:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671520:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671526:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671531:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839817.671535:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671542:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671551:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839817.671561:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839817.671596:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3615:x1875734060773120:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839817.671604:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839817.671643:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060773120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839817.673100:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060772864:12345-0@lo:104: Request processed in 8018us (8263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.673113:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788839817.673524:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843800/0xad5b343a26573d12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573d0b expref: 17 pid: 17105 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839817.673540:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060772864:0@lo:104: 00010000:00010000:1.0:1788839817.673570:0:17129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.673580:0:17129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.673586:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839817.673592:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842600/0xad5b343a26573e0e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839817.678357:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17846:x1875734060772608:12345-0@lo:253:mount.lustre.0 Request processed in 25888us (26018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.678373:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788839817.682407:0:17846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:17846:1875734060772608:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788839817.682430:0:17846:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788839817.682433:0:17846:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788839817.682450:0:17846:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788839817.682452:0:17846:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788839817.682453:0:17846:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788839817.682454:0:17846:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788839817.682455:0:17846:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788839817.682457:0:17846:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788839817.682458:0:17846:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788839817.682459:0:17846:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788839817.682476:0:17846:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1788839817.696132:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788839817.696451:0:17871:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788839817.696456:0:17871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788839817.696522:0:17872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1788839817.696941:0:17872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1788839817.697540:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788839817.698368:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1875734060773248:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788839817.698435:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.698464:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.698522:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773248 00000100:00100000:2.0:1788839817.698529:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773248 00000100:00100000:2.0:1788839817.698575:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839817.698584:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1875734060773248:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839817.698658:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1875734060773248:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.698664:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788839817.698745:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1875734060773248:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788839817.698792:0:17873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788839817.698818:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1875734060773376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788839817.698845:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.698866:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839817.698970:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773376 00000100:00100000:2.0:1788839817.698974:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773376 00000100:00100000:2.0:1788839817.698996:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839817.699001:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1875734060773376:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839817.699094:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1875734060773376:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839817.699100:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839817.699156:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1875734060773376:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788839817.699203:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17873:1875734060773504:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788839817.699230:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839817.699292:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bcc0 going to sleep for 11 seconds 00000040:01000000:0.0:1788839817.700094:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788839817.700138:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788839817.700754:0:17846:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788839817.700763:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788839817.700830:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839817.702173:0:17872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788839817.702238:0:17872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1788839817.703004:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773504 00000100:00100000:3.0:1788839817.703016:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773504 00000100:00100000:3.0:1788839817.703074:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839817.703084:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17873:x1875734060773504:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788839817.703183:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17873:x1875734060773504:12345-0@lo:900:lod0001_rec0000.0 Request processed in 100us (3951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.703191:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788839817.703218:0:17873:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab781a4a300 x1875734060773504/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839833 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839817.703245:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4a300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17873:1875734060773504:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788839817.703454:0:17873:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1875734060773632:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788839817.703495:0:17873:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839817.703527:0:17873:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab742be5840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839817.703713:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773632 00000100:00100000:3.0:1788839817.703718:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773632 00000100:00100000:3.0:1788839817.703757:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839817.703764:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1875734060773632:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788839817.703854:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17873:x1875734060773632:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 90us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839817.703860:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788839817.704128:0:17873:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17873:1875734060773632:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788839817.704174:0:17873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839817.704349:0:17846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788839817.705447:0:17846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788839817.705502:0:17846:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788839817.705751:0:17846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788839817.706348:0:17846:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:0.0:1788839817.708456:0:17846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000040:00080000:1.0:1788839817.709091:0:17873:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788839817.709151:0:17873:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788839817.709156:0:17873:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788839817.727542:0:17846:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788839817.727589:0:17846:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb6988568f988 00100000:10000000:0.0:1788839817.727597:0:17846:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788839817.732224:0:17846:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788839817.732268:0:17846:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788839817.732287:0:17846:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788839817.732336:0:17846:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788839817.733166:0:17846:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839817.733375:0:17846:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788839818.055944:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:3.0:1788839818.692237:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839818.692875:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788839819.077724:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 10000000:01000000:3.0:1788839819.520127:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788839819.520137:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7479d8000 from 8 10000000:01000000:3.0:1788839819.520143:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839819.520189:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.520202:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.520237:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839819.520264:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060773760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839819.520335:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839819.520384:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab778bb4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839819.520887:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773760 00000100:00100000:2.0:1788839819.520896:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773760 00000100:00100000:2.0:1788839819.520959:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839819.520969:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17110:x1875734060773760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839819.520984:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839819.521001:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e15 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.522670:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e15 expref: 17 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.522689:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e15 expref: 17 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.522701:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843a00, rc 0) 00000100:00100000:3.0:1788839819.522812:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060773760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1844us (2476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839819.522821:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788839819.525188:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060773760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839819.525233:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839819.525247:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839819.525330:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060773888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788839819.525394:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839819.525449:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788839819.525927:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060773888 00000100:00100000:3.0:1788839819.525936:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060773888 00000100:00100000:3.0:1788839819.525990:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788839819.526000:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060773888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788839819.526035:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788839819.526053:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788839819.526056:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788839819.526162:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060773888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839819.526170:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788839819.526387:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060773888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788839819.526452:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788839819.526461:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839819.526471:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839819.526481:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788839819.526483:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab64817e800 from 8 10000000:01000000:1.0:1788839819.526486:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788839819.526511:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839819.526519:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839819.526527:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839819.526544:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060774016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839819.526573:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839819.526608:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7506a76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839819.526869:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774016 00000100:00100000:3.0:1788839819.526890:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774016 00000100:00100000:3.0:1788839819.526928:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788839819.526936:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060774016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839819.526947:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839819.526959:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e23 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.526982:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e23 expref: 18 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.526991:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e23 expref: 18 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.526999:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553000, rc 0) 00000100:00100000:3.0:1788839819.527044:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060774016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839819.527050:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788839819.527082:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060774016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839819.527093:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.527101:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839819.527144:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060774144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788839819.527174:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839819.527187:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77668a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839819.527197:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774144 00000100:00100000:3.0:1788839819.527727:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774144 00000100:00100000:3.0:1788839819.527766:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839819.527799:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060774144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788839819.527815:0:17107:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788839819.527830:0:17107:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788839819.527832:0:17107:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788839819.527919:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060774144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839819.527927:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788839819.527964:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060774144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788839819.528007:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839819.528116:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839819.528125:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839819.711415:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788839819.713968:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839820.098493:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:3.0:1788839820.735213:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839821.120226:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00010000:00010000:3.0:1788839821.760312:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839822.153001:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 0 seconds 00000001:02000400:1.0:1788839822.295463:0:18116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788839822.722281:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788839822.722288:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788839822.722291:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839822.722316:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8ab647a27800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839822.722340:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777ca8e00 x1875734060774400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839822.722355:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839822.722358:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839822.722360:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839822.722362:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839822.722390:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839822.722393:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839822.722395:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839822.722398:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788839822.722423:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060774656:0@lo:400:kworker.0 00000100:00100000:0.0:1788839822.722487:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839822.722544:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839822.722550:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060774784:0@lo:400:kworker.0 00000100:00100000:0.0:1788839822.722580:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839822.722653:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060774272:0@lo:400:kworker.0 00000100:00100000:2.0:1788839822.722688:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839822.722718:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839822.722731:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060774528:0@lo:400:kworker.0 00000100:00100000:2.0:1788839822.722755:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839822.722805:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774784 00000100:00100000:2.0:1788839822.722812:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774784 00000100:00100000:2.0:1788839822.722868:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774528 00000100:00100000:2.0:1788839822.722871:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774528 00000100:00100000:2.0:1788839822.722890:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839822.722898:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060774784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839822.722948:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060774784:12345-0@lo:400:kworker.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839822.722954:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839822.722969:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839822.722986:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060774528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839822.723014:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060774528:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839822.723020:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839822.723050:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060774400:0@lo:38:kworker.0 00000100:00100000:2.0:1788839822.723074:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839822.723098:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774656 00000100:00100000:2.0:1788839822.723101:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774656 00000100:00100000:2.0:1788839822.723116:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774400 00000100:00100000:2.0:1788839822.723118:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774400 00000100:00100000:2.0:1788839822.723125:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839822.723130:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060774656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839822.723156:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060774656:12345-0@lo:400:kworker.0 Request processed in 26us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839822.723161:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839822.723179:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839822.723183:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875734060774400:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788839822.723203:0:17119:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:2.0:1788839822.723234:0:17119:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573e31 00000004:00100000:2.0:1788839822.723248:0:17119:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788839822.723253:0:17119:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00080000:2.0:1788839822.723336:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777ca9c00 x1875734060774528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839822.723350:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060774528:0@lo:400:kworker.0 00010000:00080000:2.0:1788839822.723380:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777ca8000 x1875734060774784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839838 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839822.723389:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060774784:0@lo:400:kworker.0 00000100:00100000:2.0:1788839822.723398:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060774656:0@lo:400:kworker.0 00000100:00100000:0.0:1788839822.723598:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774272 00000100:00100000:0.0:1788839822.723602:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774272 00000100:00100000:0.0:1788839822.723644:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839822.723652:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3616:x1875734060774272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839822.723693:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3616:x1875734060774272:12345-0@lo:400:kworker.0 Request processed in 42us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839822.723700:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839822.724367:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060774272:0@lo:400:kworker.0 00000100:00100000:1.0:1788839822.726980:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788839822.727001:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060774912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839822.727070:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839822.729279:0:17118:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788839822.729295:0:17118:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788839822.729553:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060774912 00000100:00100000:0.0:1788839822.729562:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060774912 00000100:00100000:3.0:1788839822.729721:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839822.729732:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060774912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839822.729766:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788839822.730088:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060774912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 358us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839822.730097:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839822.730182:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060774912:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788839822.734591:0:17119:0:(import.c:65:import_set_state_nolock()) ffff8ab7487dc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839822.734745:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060774400:12345-0@lo:38:kworker.0 Request processed in 11558us (11668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839822.734755:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788839822.734969:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788839822.735045:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788839822.735051:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788839822.735054:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788839822.735106:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000372e6ad2): req@ffff8ab7819fa300 x1875734060767488/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839822.735132:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060774400:0@lo:38:kworker.0 00000100:00100000:1.0:1788839822.735245:0:17156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839822.735334:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760d10000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839822.735479:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060775040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839822.735506:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839822.735679:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060767488 00000100:00100000:0.0:1788839822.735686:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060767488 00000100:00100000:3.0:1788839822.735734:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775040 00000100:00100000:3.0:1788839822.735744:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775040 00000100:00100000:3.0:1788839822.735822:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839822.735831:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17156:x1875734060767488:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788839822.735959:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17156:x1875734060767488:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 129us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839822.735966:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839822.735988:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839822.735994:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060775040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839822.736014:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788839822.736048:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060775040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839822.736054:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839822.736266:0:17156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875734060767488:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788839822.736300:0:17156:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788839822.736334:0:17156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875734060775168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788839822.736367:0:17156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839822.736397:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839822.736448:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775168 00000100:00100000:0.0:1788839822.736452:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775168 00000100:00100000:0.0:1788839822.736472:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839822.736478:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875734060775168:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839822.736579:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875734060775168:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839822.736585:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788839822.737761:0:17156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875734060775168:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788839822.738046:0:17156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875734060775296:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788839822.738094:0:17156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839822.738114:0:17156:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839822.738183:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775296 00000100:00100000:0.0:1788839822.738188:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775296 00000100:00100000:0.0:1788839822.738229:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839822.738237:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875734060775296:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788839822.738310:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17156:x1875734060775296:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839822.738385:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788839822.738559:0:17156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17156:1875734060775296:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788839822.738607:0:17156:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839822.742828:0:17156:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788839822.743189:0:17156:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788839822.743194:0:17156:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1788839822.743592:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060775040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839822.782939:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788839823.245428:0:18169:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839823.246459:0:18169:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839823.807996:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788839824.040498:0:18219:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839824.040739:0:18219:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839824.832416:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839825.170798:0:18267:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7bb7e750 20000000:00000080:1.0:1788839825.170814:0:18267:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab74e995000 uarg=0000000000000000 20000000:01000000:1.0:1788839825.170868:0:18267:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788839825.170875:0:18267:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788839825.170880:0:18267:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788839825.171383:0:18268:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788839825.171503:0:18267:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788839825.177017:0:18267:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788839825.177051:0:18267:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.177073:0:18267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573cda expref: 17 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.177081:0:18267:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ddd expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.177088:0:18267:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.177136:0:18267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573ddd expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.177150:0:18267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573ddd expref: 17 pid: 17108 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839825.177163:0:18267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18267:1875734060775424:0@lo:104: 00000100:00100000:0.0:1788839825.177230:0:18267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839825.177331:0:18267:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573cda expref: 17 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.177339:0:18267:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573cda expref: 17 pid: 17107 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839825.177347:0:18267:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18267:1875734060775552:0@lo:104: 00000100:00100000:0.0:1788839825.177367:0:18267:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839825.177428:0:18267:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839825.177499:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775424 00000100:00100000:3.0:1788839825.177506:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775424 00000100:00100000:3.0:1788839825.177541:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775552 00000100:00100000:3.0:1788839825.177543:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775552 00000100:00100000:3.0:1788839825.177554:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839825.177561:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:18267:x1875734060775424:12345-0@lo:104: 00010000:00010000:3.0:1788839825.177572:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.177674:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788839825.177680:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:18267:x1875734060775424:12345-0@lo:104: Request processed in 120us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839825.177692:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839825.177708:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839825.177713:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:18267:x1875734060775552:12345-0@lo:104: 00010000:00010000:3.0:1788839825.177720:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.177749:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788839825.177753:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:18267:x1875734060775552:12345-0@lo:104: Request processed in 41us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839825.177757:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788839825.177791:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839825.177797:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.177803:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552e00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839825.177806:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.177814:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839825.177821:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839825.177894:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839825.177921:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.177927:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839825.177951:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178027:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552e00/0xad5b343a26573ddd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573de4 expref: -99 pid: 17846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178040:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839825.178043:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178049:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839825.178052:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178058:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839825.178064:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839825.178069:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839825.178084:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178089:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839825.178094:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178100:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a26573cda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573ce1 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178121:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839825.178122:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839825.178123:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839825.178143:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060775808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839825.178174:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839825.178198:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839825.178203:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060775680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839825.178223:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839825.178246:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775808 00000100:00100000:3.0:1788839825.178250:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775808 00010000:00010000:3.0:1788839825.178270:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573cda expref: 18 pid: 17107 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839825.178289:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775680 00000100:00100000:3.0:1788839825.178292:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775680 00010000:00010000:3.0:1788839825.178302:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ddd expref: 19 pid: 17108 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839825.178314:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839825.178319:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:3615:x1875734060775808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839825.178329:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839825.178333:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573cda expref: 19 pid: 17107 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178342:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573cda expref: 19 pid: 17107 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178356:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839825.178389:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:3615:x1875734060775808:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839825.178395:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788839825.178407:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839825.178413:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3615:x1875734060775680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839825.178420:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839825.178424:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ddd expref: 18 pid: 17108 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178433:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573ddd expref: 18 pid: 17108 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178443:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178449:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178461:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178467:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178473:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178478:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178483:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839825.178492:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178499:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178505:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839825.178514:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839825.178534:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3615:x1875734060775680:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839825.178539:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788839825.178572:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060775680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839825.178579:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4b73860-6950-4a5d-8d03-52a643e5ff43:3615:1875734060775808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839825.178664:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839825.179067:0:18267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959400/0xad5b343a26573de4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573ddd expref: 17 pid: 17108 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839825.179081:0:18267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18267:1875734060775424:0@lo:104: 00010000:00010000:0.0:1788839825.179091:0:18267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ce1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573cda expref: 16 pid: 17107 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839825.179098:0:18267:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18267:1875734060775552:0@lo:104: 00010000:00010000:0.0:1788839825.179114:0:18267:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.179122:0:18267:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.179127:0:18267:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839825.179132:0:18267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfd600/0xad5b343a26573e38 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18267 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839825.216807:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839825.855018:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839826.879224:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788839826.879286:0:17110:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839826.879290:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7479d8000 from 13 10000000:01000000:0.0:1788839826.879296:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839826.879340:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.879353:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.879363:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839826.879400:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060775936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.879465:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839826.879511:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839826.879566:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060775936 00000100:00100000:2.0:1788839826.879573:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060775936 00000100:00100000:2.0:1788839826.879624:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839826.879634:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+16:17110:x1875734060775936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839826.879650:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839826.879665:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e3f expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839826.879687:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e3f expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839826.879698:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e3f expref: 17 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839826.879706:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842c00, rc 0) 00000100:00100000:2.0:1788839826.879745:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060775936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839826.879763:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788839826.879871:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060775936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839826.879886:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.879894:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839826.879960:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.879993:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839826.880019:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839826.880067:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776064 00000100:00100000:2.0:1788839826.880071:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776064 00000100:00100000:2.0:1788839826.880102:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839826.880108:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060776064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839826.880213:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060776064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839826.880220:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839826.880343:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.880373:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.880413:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839826.880437:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4876c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839826.880485:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776192 00000100:00100000:2.0:1788839826.880489:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776192 00000100:00100000:2.0:1788839826.880520:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788839826.880526:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060776192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839826.880611:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060776192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839826.880618:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788839826.880700:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788839826.881802:0:18340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788839826.882001:0:17110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788839826.882023:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839826.882034:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839826.882045:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839826.882055:0:17110:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839826.882058:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab64817e800 from 13 10000000:01000000:2.0:1788839826.882061:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839826.882092:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839826.882100:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839826.882109:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839826.882132:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839826.882182:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839826.882218:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e4bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839826.882383:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776320 00000100:00100000:0.0:1788839826.882390:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776320 00000100:00100000:0.0:1788839826.882434:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839826.882442:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+17:17110:x1875734060776320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839826.882454:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839826.882476:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e4d expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.882499:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e4d expref: 18 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.882509:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e4d expref: 18 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.882517:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd200, rc 0) 00000100:00100000:0.0:1788839826.882557:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060776320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839826.882564:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839826.882604:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839826.882616:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839826.882624:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839826.882676:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.882701:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839826.882714:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4873c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839826.882725:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776448 00000100:00100000:0.0:1788839826.882728:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776448 00000100:00100000:0.0:1788839826.882750:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788839826.882756:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060776448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.882899:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060776448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839826.882913:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788839826.883381:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.883418:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839826.883460:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839826.883522:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4873c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839826.889379:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776576 00000100:00100000:2.0:1788839826.889395:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776576 00000100:00100000:2.0:1788839826.889635:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839826.889647:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060776576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839826.889936:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:17110:x1875734060776576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (6474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839826.889955:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788839826.890058:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060776576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839826.890695:0:18341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788839826.890750:0:17110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788839826.890806:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839826.890817:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839826.890839:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839827.838966:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839817/real 1788839817] req@ffff8ab7819f8700 x1875734060770688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839827.838999:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab7819f8700 x1875734060770688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839827.839010:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839817/real 1788839817] req@ffff8ab781a48a80 x1875734060770560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839827 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839827.839022:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab781a48a80 x1875734060770560/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839827 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839827.839040:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839827.839064:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839827.839068:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060770688:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788839827.839073:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839827.839079:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839827.839082:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060770560:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788839827.839255:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839827.839259:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839827.839262:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839827.839265:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839827.839311:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839827.839315:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788839827.839317:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839827.839323:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1788839827.839327:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839827.839333:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab648168000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839827.839353:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777ca8380 x1875734060777216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839827.839378:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839827.839381:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788839827.839383:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839827.839386:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 472 00000100:00080000:0.0:1788839827.839389:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788839827.839392:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab646b66800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839827.839421:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777cab480 x1875734060777344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839827.839475:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060776704:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.839538:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839827.839577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060777472:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.839606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839827.839628:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839827.839634:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060776832:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.839660:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839827.839686:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060776960:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.839712:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839827.839730:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839827.839735:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060777088:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.839793:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839827.839834:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776704 00000100:00100000:0.0:1788839827.839841:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776704 00000100:00100000:0.0:1788839827.839886:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839827.839895:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3616:x1875734060776704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.839939:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3616:x1875734060776704:12345-0@lo:400:kworker.0 Request processed in 46us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839827.839946:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788839827.839987:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060777472 00000100:00100000:0.0:1788839827.839991:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060777472 00000100:00100000:0.0:1788839827.840016:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776960 00000100:00100000:0.0:1788839827.840018:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776960 00000100:00100000:0.0:1788839827.840036:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839827.840042:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060777472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.840079:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060777472:12345-0@lo:400:kworker.0 Request processed in 37us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839827.840086:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839827.840098:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839827.840103:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060776960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.840129:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060776960:12345-0@lo:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839827.840134:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839827.840148:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060776832 00000100:00100000:0.0:1788839827.840151:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060776832 00000100:00100000:0.0:1788839827.840172:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060777088 00000100:00100000:0.0:1788839827.840175:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060777088 00000100:00100000:0.0:1788839827.840186:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839827.840191:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060776832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.840220:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060776832:12345-0@lo:400:kworker.0 Request processed in 29us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839827.840226:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788839827.840237:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839827.840242:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060777088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.840266:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060777088:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839827.840272:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788839827.840318:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060777088:0@lo:400:kworker.0 00010000:00080000:0.0:1788839827.840332:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777ca8a80 x1875734060776960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839827.840341:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060776960:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.840373:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060777216:0@lo:8:kworker.0 00000400:00000100:0.0:1788839827.840398:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060777216 offset 0 length 520: 4 00000100:00100000:0.0:1788839827.840418:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060777344:0@lo:8:kworker.0 00000400:00000100:0.0:1788839827.840435:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060777344 offset 0 length 520: 4 00000100:00100000:0.0:1788839827.840464:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060776832:0@lo:400:kworker.0 00000100:00100000:0.0:1788839827.840473:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060776704:0@lo:400:kworker.0 00010000:00080000:0.0:1788839827.840483:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777ca8000 x1875734060777472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839843 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839827.840492:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060777472:0@lo:400:kworker.0 00000100:00100000:2.0:1788839827.841099:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839827.841111:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060777600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839827.841145:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839827.841216:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060777600 00000100:00100000:1.0:1788839827.841222:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060777600 00000100:00100000:1.0:1788839827.841258:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839827.841264:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060777600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839827.841291:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839827.841348:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060777600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839827.841355:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839827.841385:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060777600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839827.843529:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060777728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839827.843589:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788839827.843637:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788839827.843676:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060777728 00000100:00100000:3.0:1788839827.843684:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060777728 00000100:00100000:3.0:1788839827.843730:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839827.843737:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060777728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788839827.843805:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788839827.844109:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060777728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 372us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839827.844116:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839827.844179:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060777728:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839827.908260:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839828.931999:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839829.886969:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839814/real 1788839814] req@ffff8ab777caa300 x1875734060768640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839829 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839829.887005:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777caa300 x1875734060768640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839829 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839829.887016:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839814/real 1788839814] req@ffff8ab777cabb80 x1875734060768768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839829 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839829.887027:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777cabb80 x1875734060768768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839829 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839829.887053:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839829.887075:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839829.887078:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768640:0@lo:8:kworker.0 00000100:00080000:2.0:1788839829.887083:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839829.887088:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839829.887091:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060768768:0@lo:8:kworker.0 00000100:00080000:0.0:1788839829.887950:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839829.887955:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788839829.887958:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839829.887964:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:0.0:1788839829.887969:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788839829.887976:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab646534800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839829.887996:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777eedc00 x1875734060778112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839829.888020:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839829.888024:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788839829.888026:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788839829.888029:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:0.0:1788839829.888032:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:2.0:1788839829.888051:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060778112:0@lo:8:kworker.0 00000100:00080000:0.0:1788839829.888055:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab647a27000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1788839829.888072:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab777eee300 x1875734060778240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788839829.888099:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839829.888103:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788839829.888106:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788839829.888109:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000400:00000100:2.0:1788839829.888120:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060778112 offset 0 length 520: 4 00000100:00100000:0.0:1788839829.888134:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060778496:0@lo:400:kworker.0 00000100:00100000:2.0:1788839829.888168:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060778240:0@lo:8:kworker.0 00000100:00100000:0.0:1788839829.888177:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:2.0:1788839829.888202:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875734060778240 offset 0 length 520: 4 00000100:00100000:0.0:1788839829.888205:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788839829.888214:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060777856:0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888242:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839829.888259:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060778624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888280:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839829.888305:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060778368:0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888326:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839829.888350:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839829.888355:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060777984:0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888376:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839829.888406:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060778496 00000100:00100000:0.0:1788839829.888414:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060778496 00000100:00100000:0.0:1788839829.888453:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060777984 00000100:00100000:0.0:1788839829.888456:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060777984 00000100:00100000:0.0:1788839829.888471:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839829.888479:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060778496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839829.888536:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060778624 00000100:00100000:0.0:1788839829.888537:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060778496:12345-0@lo:400:kworker.0 Request processed in 57us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839829.888543:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060778624 00000100:00100000:0.0:1788839829.888549:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839829.888569:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788839829.888576:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060777984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839829.888583:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060778368 00000100:00100000:2.0:1788839829.888595:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060778368 00000100:00100000:0.0:1788839829.888610:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060777984:12345-0@lo:400:kworker.0 Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839829.888617:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839829.888628:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839829.888639:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060778624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888640:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060777856 00000100:00100000:0.0:1788839829.888646:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060777856 00000100:00100000:0.0:1788839829.888673:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788839829.888680:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3614:x1875734060777856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839829.888687:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060778624:12345-0@lo:400:kworker.0 Request processed in 50us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839829.888695:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839829.888716:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839829.888716:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:3614:x1875734060777856:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839829.888726:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788839829.888731:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060778368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839829.888794:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060778368:12345-0@lo:400:kworker.0 Request processed in 68us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839829.888801:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839829.888834:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060777984:0@lo:400:kworker.0 00010000:00080000:0.0:1788839829.888848:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777eec000 x1875734060778368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839829.888856:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060778368:0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888884:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060777856:0@lo:400:kworker.0 00010000:00080000:0.0:1788839829.888892:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab777eeea00 x1875734060778624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839829.888901:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060778624:0@lo:400:kworker.0 00000100:00100000:0.0:1788839829.888924:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060778496:0@lo:400:kworker.0 00010000:00010000:1.0:1788839829.951939:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839829.952499:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839830.975089:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788839831.419856:0:18616:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788839831.419859:0:18616:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788839831.419861:0:18616:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788839831.420239:0:18616:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab75e47c000 00000020:01000004:3.0:1788839831.420257:0:18616:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788839831.420277:0:18616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788839831.420292:0:18616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ab6466919b8) 00000020:00000080:3.0:1788839831.420310:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788839831.507209:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788839831.510876:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788839831.511438:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788839831.511901:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788839831.512221:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788839831.512444:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788839831.512899:0:18616:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1788839831.514231:0:18616:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788839831.514457:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788839831.514484:0:18616:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788839831.514504:0:18616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad5b343a26573e62 00000020:01000004:2.0:1788839831.514511:0:18616:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788839831.514534:0:18616:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788839831.514538:0:18616:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788839831.514544:0:18616:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788839831.514549:0:18616:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788839831.514571:0:18616:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ab7487d0000) 00000020:00000080:2.0:1788839831.514583:0:18616:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788839831.516548:0:18616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839831.516732:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839831.516739:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788839831.518184:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839831.518194:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788839831.520418:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788839831.520434:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788839831.523610:0:18616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839831.523886:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839831.523894:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788839831.525266:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788839831.525277:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788839831.550236:0:18616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839831.550618:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788839831.550626:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788839831.553338:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788839831.553357:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788839831.555541:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788839831.555555:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788839831.560215:0:18616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839831.560429:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839831.560436:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788839831.561694:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788839831.561704:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788839831.622551:0:18616:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788839831.623303:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788839831.623309:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788839831.625393:0:18616:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788839831.625405:0:18616:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788839831.625946:0:18616:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788839831.625977:0:18616:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788839831.625983:0:18616:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788839831.650461:0:18616:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788839831.650552:0:18616:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788839831.650557:0:18616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788839831.650559:0:18616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839831.650560:0:18616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839831.650562:0:18616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839831.650563:0:18616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839831.650564:0:18616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839831.650566:0:18616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839831.650567:0:18616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839831.650568:0:18616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839831.650572:0:18616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788839831.650574:0:18616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839831.650578:0:18616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839831.650579:0:18616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839831.650580:0:18616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839831.650581:0:18616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839831.650582:0:18616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839831.650583:0:18616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839831.650584:0:18616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839831.650585:0:18616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839831.650610:0:18616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788839831.650628:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060778752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839831.650764:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839831.650964:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.651100:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060778752 00000100:00100000:0.0:1788839831.651107:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060778752 00000100:00100000:0.0:1788839831.651157:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788839831.651165:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:18616:x1875734060778752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788839831.651200:0:17108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788839831.651203:0:17108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788839831.651207:0:17108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788839831.652046:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:18616:x1875734060778752:12345-0@lo:253:mount.lustre.0 Request processed in 877us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.652055:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788839831.652172:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060778752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788839831.652183:0:18616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788839831.652185:0:18616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788839831.652187:0:18616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839831.652188:0:18616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839831.652189:0:18616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839831.652190:0:18616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839831.652191:0:18616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839831.652193:0:18616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839831.652194:0:18616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839831.652195:0:18616:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788839831.652211:0:18616:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab75e47c000 from lustre-OST0000 10000000:01000000:1.0:1788839831.652235:0:18616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788839831.652237:0:18616:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788839831.652245:0:18616:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab777fb4d28 local copy 00010000:00010000:1.0:1788839831.652254:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839831.652343:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060778880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839831.652374:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839831.652435:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.656507:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060778880 00000100:00100000:0.0:1788839831.656533:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060778880 00000100:00100000:0.0:1788839831.656596:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788839831.656607:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:18616:x1875734060778880:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839831.657241:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:18616:x1875734060778880:12345-0@lo:501:mount.lustre.0 Request processed in 634us (4862us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839831.657250:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788839831.657411:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060778880:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788839831.657452:0:18616:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788839831.657491:0:18616:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788839831.657501:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.657512:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839831.657543:0:18616:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab75e47c000 10000000:01000000:1.0:1788839831.657549:0:18616:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839831.657554:0:18616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788839831.657558:0:18616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839831.657563:0:18616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788839831.657566:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788839831.657599:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.657607:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.657615:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839831.657636:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839831.657756:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839831.658010:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.658258:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779008 00000100:00100000:0.0:1788839831.658265:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779008 00000100:00100000:0.0:1788839831.658365:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788839831.658375:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+18:18616:x1875734060779008:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839831.658386:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839831.658401:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfd800/0xad5b343a26573e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e70 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.658425:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfd800/0xad5b343a26573e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e70 expref: 19 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.658436:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfd800/0xad5b343a26573e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e70 expref: 19 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.658445:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfd800, rc 0) 00000100:00100000:0.0:1788839831.658500:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779008:12345-0@lo:101:mount.lustre.0 Request processed in 127us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.658507:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788839831.658585:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839831.658599:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.658614:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839831.664686:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788839831.666253:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788839831.671494:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788839831.671569:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788839831.671586:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788839831.671599:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788839831.671611:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788839831.671622:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788839831.671650:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788839831.671665:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788839831.672711:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839831.673564:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839831.673671:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a52900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.673965:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779136 00000100:00100000:0.0:1788839831.673975:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779136 00000100:00100000:3.0:1788839831.674138:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788839831.674150:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779136:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839831.674377:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779136:12345-0@lo:501:mount.lustre.0 Request processed in 227us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839831.674385:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788839831.674542:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839831.674665:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779264:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839831.675031:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839831.675138:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745088540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.675212:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779264 00000100:00100000:0.0:1788839831.675218:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779264 00000100:00100000:0.0:1788839831.675298:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788839831.675307:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839831.676454:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779264:12345-0@lo:503:mount.lustre.0 Request processed in 1144us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.676474:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788839831.676626:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779264:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788839831.677346:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839831.677422:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779392:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839831.677542:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839831.677631:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745c04900 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.678106:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779392 00000100:00100000:0.0:1788839831.678114:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779392 00000100:00100000:0.0:1788839831.678187:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788839831.678196:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839831.678631:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779392:12345-0@lo:502:mount.lustre.0 Request processed in 435us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.678638:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788839831.678727:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839831.678993:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788839831.679024:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788839831.679051:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788839831.679067:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788839831.679081:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788839831.679093:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788839831.679107:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788839831.679120:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788839831.679134:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788839831.679161:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788839831.679178:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788839831.679191:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788839831.679224:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839831.679266:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839831.680062:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788839831.680200:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779520 00000100:00100000:3.0:1788839831.680208:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779520 00000100:00100000:3.0:1788839831.680244:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788839831.680251:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779520:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839831.680362:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779520:12345-0@lo:502:mount.lustre.0 Request processed in 111us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839831.680370:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788839831.680476:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839831.680541:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788839831.680551:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788839831.682767:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788839831.686351:0:18633:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788839831.686460:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.686471:0:18633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788839831.686483:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839831.686500:0:18633:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ab646694d28) 00000020:00000080:3.0:1788839831.686527:0:18633:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788839831.686532:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788839831.686647:0:18633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab75e47c000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788839831.686657:0:18633:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788839831.686665:0:18633:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xad5b343a26573e85 00010000:00010000:3.0:1788839831.697395:0:18633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788839831.698384:0:18633:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788839831.700664:0:18633:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788839831.702348:0:18633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788839831.702360:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839831.702366:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.702368:0:18633:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788839831.702371:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788839831.702374:0:18633:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788839831.702375:0:18633:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839831.702377:0:18633:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788839831.702378:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788839831.702381:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.702383:0:18633:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788839831.702385:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839831.702388:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.702389:0:18633:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788839831.702392:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788839831.702394:0:18633:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788839831.702397:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839831.702398:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.702399:0:18633:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788839831.702401:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839831.702403:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.702404:0:18633:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788839831.702407:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788839831.702443:0:18633:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839831.704740:0:18633:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839831.704748:0:18633:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788839831.704755:0:18633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788839831.707131:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788839831.707171:0:18616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788839831.708839:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.708855:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647959200/0xad5b343a26573e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e77 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839831.708864:0:18616:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab75e47c000 from 1 10000000:01000000:0.0:1788839831.708867:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839831.708902:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.708910:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.708920:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839831.708944:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788839831.709007:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.709047:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d43180 going to sleep for 11 seconds 00000100:00100000:3.0:1788839831.709192:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779648 00000100:00100000:3.0:1788839831.709201:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779648 00000100:00100000:3.0:1788839831.709251:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788839831.709260:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:18616:x1875734060779648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839831.709272:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839831.709285:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e8c expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839831.709309:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e8c expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839831.709319:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e8c expref: 20 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839831.709326:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552e00, rc 0) 00000100:00100000:3.0:1788839831.709363:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060779648:12345-0@lo:101:mount.lustre.0 Request processed in 104us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839831.709369:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788839831.709605:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839831.709620:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.709638:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788839831.710761:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788839831.711147:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788839831.711296:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788839831.711322:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788839831.712850:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788839831.712863:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788839831.713092:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839831.713169:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.713232:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839831.716010:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779776 00000100:00100000:2.0:1788839831.716025:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779776 00000100:00100000:2.0:1788839831.716092:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788839831.716103:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060779776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839831.716273:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060779776:12345-0@lo:501:mount.lustre.0 Request processed in 171us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839831.716282:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788839831.716310:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839831.716370:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779904:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788839831.716436:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.716638:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d439c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839831.717052:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060779904 00000100:00100000:2.0:1788839831.717058:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060779904 00000100:00100000:2.0:1788839831.717100:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788839831.717109:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060779904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839831.717214:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060779904:12345-0@lo:503:mount.lustre.0 Request processed in 107us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839831.717222:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788839831.718079:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060779904:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788839831.718479:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788839831.718549:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780032:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839831.718867:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.718898:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d43180 going to sleep for 11 seconds 00000100:00100000:2.0:1788839831.719081:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780032 00000100:00100000:2.0:1788839831.719096:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780032 00000100:00100000:2.0:1788839831.719142:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788839831.719150:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060780032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839831.719266:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060780032:12345-0@lo:502:mount.lustre.0 Request processed in 116us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839831.719274:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788839831.723103:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839831.723424:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788839831.723455:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788839831.723469:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788839831.723481:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788839831.723494:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788839831.723507:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788839831.723520:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788839831.723546:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788839831.723558:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788839831.723570:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788839831.723581:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788839831.723625:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780160:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839831.723696:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839831.723746:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487840 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.724123:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780160 00000100:00100000:0.0:1788839831.724131:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780160 00000100:00100000:0.0:1788839831.724187:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788839831.724196:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060780160:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839831.724337:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060780160:12345-0@lo:502:mount.lustre.0 Request processed in 141us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.724345:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788839831.724930:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780160:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839831.725003:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788839831.725013:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788839831.730963:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839831.730987:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.730989:0:18637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788839831.730996:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab75e47c000 00000020:00000080:1.0:1788839831.731000:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839831.731007:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839831.731009:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731129:0:18637:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788839831.731135:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839831.731139:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731141:0:18637:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788839831.731144:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab75e47c000 00000020:00000080:1.0:1788839831.731146:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839831.731212:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839831.731217:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731218:0:18637:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788839831.731220:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839831.731222:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731224:0:18637:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839831.731227:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab75e47c000 00000020:00000080:1.0:1788839831.731229:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839831.731248:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839831.731251:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731252:0:18637:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788839831.731255:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788839831.731257:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731258:0:18637:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788839831.731261:0:18637:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab75e47c000 00000020:00000080:1.0:1788839831.731263:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788839831.731286:0:18637:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788839831.731290:0:18637:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788839831.731291:0:18637:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788839831.731294:0:18637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788839831.736297:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788839831.736340:0:18616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839831.736356:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.736377:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839831.736456:0:18616:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788839831.736459:0:18616:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab75e47c000 10000000:01000000:2.0:1788839831.736462:0:18616:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab75e47c000 10000000:01000000:2.0:1788839831.736467:0:18616:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839831.736473:0:18616:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab75e47c000 from 1 10000000:01000000:2.0:1788839831.736476:0:18616:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839831.736514:0:18616:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.736523:0:18616:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.736532:0:18616:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839831.736566:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839831.736637:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839831.736671:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.739648:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780288 00000100:00100000:0.0:1788839831.739661:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780288 00000100:00100000:0.0:1788839831.740284:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788839831.740298:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:18616:x1875734060780288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839831.740316:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839831.740334:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ea1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573e9a expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.740362:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573e9a expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.740374:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfc000/0xad5b343a26573ea1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e9a expref: 21 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.740383:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfc000, rc 0) 00000100:00100000:0.0:1788839831.740461:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780288:12345-0@lo:101:mount.lustre.0 Request processed in 166us (3823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.740468:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788839831.741160:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839831.741181:0:18616:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839831.741192:0:18616:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839831.745325:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788839831.745636:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839831.745867:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788839831.745906:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788839831.745925:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788839831.745939:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788839831.748689:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788839831.748721:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788839831.748736:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788839831.748749:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788839831.748764:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788839831.748816:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788839831.748830:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788839831.748857:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788839831.748870:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788839831.748883:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788839831.748897:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788839831.748909:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788839831.748922:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788839831.749137:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788839831.749154:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788839831.749165:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788839831.749178:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788839831.749190:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788839831.749203:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788839831.749218:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788839831.749232:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788839831.749246:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788839831.749260:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788839831.749273:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788839831.749286:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788839831.749299:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788839831.749310:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788839831.749322:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788839831.749335:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788839831.749364:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788839831.749381:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788839831.749394:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788839831.749407:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788839831.749436:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788839831.749441:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788839831.749579:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839831.749663:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839831.752196:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4879c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.758212:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780416 00000100:00100000:0.0:1788839831.758226:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780416 00000100:00100000:0.0:1788839831.758294:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788839831.758492:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780416:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839831.758663:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780416:12345-0@lo:501:mount.lustre.0 Request processed in 360us (9001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.758681:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788839831.760550:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839831.760616:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839831.760703:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839831.760746:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e4879c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839831.760833:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780544 00000100:00100000:3.0:1788839831.760839:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780544 00000100:00100000:3.0:1788839831.760881:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788839831.760889:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780544:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839831.761007:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780544:12345-0@lo:503:mount.lustre.0 Request processed in 119us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839831.761015:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788839831.761540:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780544:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788839831.762147:0:18616:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788839831.762229:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839831.762284:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839831.762319:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78480 going to sleep for 11 seconds 00000100:00100000:3.0:1788839831.762401:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780672 00000100:00100000:3.0:1788839831.762407:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780672 00000100:00100000:3.0:1788839831.762443:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788839831.762451:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780672:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839831.762541:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780672:12345-0@lo:502:mount.lustre.0 Request processed in 90us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839831.762548:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788839831.763893:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780672:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839831.764197:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788839831.764225:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788839831.764238:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788839831.764249:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788839831.764261:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788839831.764272:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788839831.764300:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788839831.764314:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788839831.764327:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788839831.765071:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788839831.765099:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788839831.765111:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788839831.765121:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788839831.765131:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788839831.765142:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788839831.765153:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788839831.765163:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788839831.765174:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788839831.765185:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788839831.765197:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788839831.765207:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788839831.765218:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788839831.765246:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788839831.765260:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788839831.765272:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788839831.765284:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788839831.765297:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788839831.765307:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788839831.765317:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788839831.765327:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788839831.765337:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788839831.765348:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788839831.765370:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788839831.765382:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788839831.765393:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788839831.765405:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788839831.765416:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788839831.765428:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788839831.765461:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788839831.765477:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788839831.765488:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788839831.765500:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788839831.765512:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788839831.765524:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788839831.765536:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788839831.765548:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788839831.765560:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788839831.765572:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788839831.765626:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780800:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839831.765697:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839831.765739:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78480 going to sleep for 11 seconds 00000100:00100000:3.0:1788839831.765944:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780800 00000100:00100000:3.0:1788839831.765952:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780800 00000100:00100000:3.0:1788839831.765995:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788839831.766004:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839831.766141:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780800:12345-0@lo:502:mount.lustre.0 Request processed in 136us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839831.766149:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788839831.767239:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780800:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788839831.767438:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788839831.768308:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788839831.768348:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780928:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839831.768416:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839831.768474:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78480 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.768544:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060780928 00000100:00100000:0.0:1788839831.768551:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060780928 00000100:00100000:0.0:1788839831.768604:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788839831.768613:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780928:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788839831.768730:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060780928:12345-0@lo:502:mount.lustre.0 Request processed in 117us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.768738:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788839831.769288:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060780928:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839831.769496:0:18616:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788839831.769507:0:18616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788839831.781096:0:18643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788839831.781113:0:18643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab6479e8000) 00000020:00000080:0.0:1788839831.781136:0:18643:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788839831.781222:0:18643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab75e47c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788839831.781226:0:18643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab75e47c000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788839831.781229:0:18643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab75e47c000 3 00010000:00080000:0.0:1788839831.781260:0:18643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab75867c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1788839831.782871:0:18643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788839831.783502:0:18643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788839831.783550:0:18643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839831.783561:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xad5b343a26573eaf 00000100:00080000:2.0:1788839831.783571:0:18643:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839831.783577:0:18643:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab75867c000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839831.783617:0:18643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819fa680 x1875734060781056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788839831.783808:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060781056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839831.783879:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839831.785999:0:18643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788839831.786134:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.786148:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839831.786150:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.786153:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839831.786226:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060781440:0@lo:400:kworker.0 00000100:00100000:2.0:1788839831.786286:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788839831.786334:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.786338:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839831.786340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.786343:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788839831.786424:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781056 00000100:00100000:0.0:1788839831.786433:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781056 00000100:00100000:0.0:1788839831.786483:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788839831.786491:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060781056:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788839831.786515:0:17115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:0.0:1788839831.786564:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xad5b343a26573eb6 00000004:00100000:0.0:1788839831.786580:0:17115:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788839831.786611:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8ab64663b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839831.786672:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875734060781056:12345-0@lo:38:llog_process_th.0 Request processed in 180us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.786679:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839831.786829:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7819fa680 x1875734060781056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839831.786840:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839831.786847:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788839831.786854:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788839831.786859:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788839831.786861:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab75867c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788839831.786867:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875734060781056:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788839831.787204:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839831.787214:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060781568:0@lo:400:kworker.0 00000100:00100000:2.0:1788839831.787246:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839831.787296:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781440 00000100:00100000:2.0:1788839831.787301:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781440 00000100:00100000:2.0:1788839831.787342:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839831.787350:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060781440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839831.787393:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060781440:12345-0@lo:400:kworker.0 Request processed in 44us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839831.787400:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839831.787431:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060781440:0@lo:400:kworker.0 00000100:00100000:0.0:1788839831.787684:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781568 00000100:00100000:0.0:1788839831.787689:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781568 00000100:00100000:0.0:1788839831.787723:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839831.787732:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060781568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839831.787813:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875734060781568:12345-0@lo:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.787820:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788839831.788070:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab647bb4000 x1875734060781568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839831.788080:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875734060781568:0@lo:400:kworker.0 00000020:01000004:2.0:1788839831.788362:0:18643:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788839831.788377:0:18643:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8ab7487d3370) 00000020:00000080:2.0:1788839831.788397:0:18643:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788839831.788746:0:18643:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab75e47c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788839831.788752:0:18643:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab75e47c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788839831.788755:0:18643:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab75e47c000 3 00000100:00100000:0.0:1788839831.788897:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060781312:0@lo:400:kworker.0 00000100:00100000:0.0:1788839831.788937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788839831.791408:0:18643:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab7766f3800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.152@tcp at head 00000100:00100000:0.0:1788839831.794036:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839831.794055:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060781184:0@lo:400:kworker.0 00000100:00100000:0.0:1788839831.794111:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.794164:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781184 00000100:00100000:0.0:1788839831.794171:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781184 00000100:00100000:0.0:1788839831.794212:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839831.794228:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060781184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839831.794291:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060781184:12345-0@lo:400:kworker.0 Request processed in 62us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.794299:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839831.794349:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060781184:0@lo:400:kworker.0 00000100:00100000:0.0:1788839831.794380:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781312 00000100:00100000:0.0:1788839831.794384:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781312 00000100:00100000:0.0:1788839831.794413:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839831.794422:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060781312:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788839831.794574:0:18643:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788839831.794886:0:18643:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000100:00100000:0.0:1788839831.794899:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060781312:12345-0@lo:400:kworker.0 Request processed in 477us (5959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.794907:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000010:01000000:2.0:1788839831.794930:0:18643:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839831.794944:0:18643:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xad5b343a26573ec4 00000100:00080000:2.0:1788839831.794952:0:18643:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839831.794956:0:18643:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8ab7766f3800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839831.795097:0:18643:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819fa680 x1875734060781696/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839831.795186:0:18643:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:0.0:1788839831.796068:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab647bb4e00 x1875734060781312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839831.796087:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060781312:0@lo:400:kworker.0 00000100:00080000:1.0:1788839831.796113:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.796119:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839831.796121:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.796124:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839831.796127:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.796129:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788839831.796132:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788839831.796134:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788839831.796182:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060781696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839831.796238:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.796286:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781696 00000100:00100000:0.0:1788839831.796292:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781696 00000100:00100000:0.0:1788839831.796327:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839831.796334:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875734060781696:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788839831.796361:0:17113:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 486 last 0 00000040:00080000:2.0:1788839831.796362:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:00000080:0.0:1788839831.796409:0:17113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xad5b343a26573ecb 00000004:00100000:0.0:1788839831.796426:0:17113:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:01000000:1.0:1788839831.796438:0:18616:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788839831.796474:0:18616:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788839831.796494:0:18616:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.796506:0:18616:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647842a00/0xad5b343a26573e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ea1 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788839831.796566:0:18616:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788839831.796569:0:18616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839831.796570:0:18616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839831.796571:0:18616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839831.796573:0:18616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839831.796574:0:18616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839831.796575:0:18616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839831.796577:0:18616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839831.796579:0:18616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839831.796583:0:18616:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788839831.796586:0:18616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839831.796588:0:18616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788839831.796589:0:18616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839831.796590:0:18616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839831.796591:0:18616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839831.796592:0:18616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839831.796593:0:18616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839831.796594:0:18616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839831.796596:0:18616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788839831.796617:0:18616:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788839831.796631:0:18616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060781824:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839831.796671:0:18616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788839831.796680:0:17113:0:(import.c:65:import_set_state_nolock()) ffff8ab646638000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839831.796692:0:18616:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746a52cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839831.796747:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875734060781696:12345-0@lo:38:llog_process_th.0 Request processed in 412us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.796756:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788839831.796810:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab7819fa680 x1875734060781696/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839831.796819:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788839831.796825:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788839831.796831:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788839831.796836:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788839831.796838:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab7766f3800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788839831.796844:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875734060781696:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788839831.797178:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781824 00000100:00100000:0.0:1788839831.797183:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781824 00000100:00100000:0.0:1788839831.797260:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788839831.797269:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060781824:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788839831.797291:0:17105:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788839831.797303:0:17105:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788839831.801170:0:17105:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788839831.801190:0:17105:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788839831.802200:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:18616:x1875734060781824:12345-0@lo:253:mount.lustre.0 Request processed in 4926us (5521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.802213:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788839831.802526:0:18616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:18616:1875734060781824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788839831.802542:0:18616:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788839831.802545:0:18616:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788839831.802547:0:18616:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788839831.802548:0:18616:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788839831.802549:0:18616:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788839831.802550:0:18616:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788839831.802552:0:18616:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788839831.802553:0:18616:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788839831.802554:0:18616:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788839831.802556:0:18616:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788839831.802569:0:18616:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788839831.803707:0:17129:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788839831.803713:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788839831.803732:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.803751:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e15 expref: 20 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.803760:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.803829:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.803869:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.803884:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839831.803899:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060781952:0@lo:104: 00000100:00100000:1.0:1788839831.803963:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788839831.804010:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573e15 expref: 20 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804018:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573e15 expref: 20 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839831.804026:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060782080:0@lo:104: 00000100:00100000:1.0:1788839831.804050:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839831.804071:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060781952 00000100:00100000:1.0:1788839831.804077:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938600 going to sleep for 11 seconds 00000100:00100000:2.0:1788839831.804079:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060781952 00000100:00100000:1.0:1788839831.804271:0:17097:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788839831.804283:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782080 00000100:00100000:1.0:1788839831.804287:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782080 00000100:00100000:1.0:1788839831.804312:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839831.804320:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77e44f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:17129:x1875734060782080:12345-0@lo:104: 00010000:00010000:1.0:1788839831.804332:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804380:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788839831.804386:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77e44f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:17129:x1875734060782080:12345-0@lo:104: Request processed in 67us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839831.804393:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788839831.804409:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788839831.804414:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060781952:12345-0@lo:104: 00010000:00010000:1.0:1788839831.804421:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804455:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788839831.804459:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060781952:12345-0@lo:104: Request processed in 46us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839831.804465:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788839831.804473:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839831.804481:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804490:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552800 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:2.0:1788839831.804494:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804503:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788839831.804511:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839831.804514:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060781952:0@lo:104: 10000000:01000000:2.0:1788839831.804524:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788839831.804527:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060782080:0@lo:104: 00010000:00010000:1.0:1788839831.804546:0:17129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804557:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804561:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839831.804578:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788839831.804603:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804611:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552800/0xad5b343a26573e15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e1c expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804625:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839831.804628:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839831.804636:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839831.804655:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060782208:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788839831.804662:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839831.804670:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804678:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:1.0:1788839831.804682:0:17102:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804690:0:17102:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839831.804691:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788839831.804701:0:17102:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839831.804707:0:17102:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788839831.804728:0:17102:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804734:0:17102:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788839831.804735:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782208 00000100:00100000:2.0:1788839831.804741:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782208 00010000:00010000:1.0:1788839831.804746:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804753:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573e23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e2a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804759:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e15 expref: 21 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839831.804767:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839831.804806:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839831.804808:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839831.804811:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839831.804813:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839831.804877:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839831.804885:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3616:x1875734060782208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839831.804899:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839831.804904:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e15 expref: 21 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804912:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573e15 expref: 21 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804925:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647843a00/0xad5b343a26573e1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573e15 expref: 21 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839831.804947:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839831.804973:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:3616:x1875734060782208:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839831.805053:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839831.805090:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060782208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839831.805543:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839831.805554:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060782336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839831.805593:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839831.805645:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782336 00000100:00100000:0.0:1788839831.805652:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782336 00010000:00010000:0.0:1788839831.805674:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839831.805700:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839831.805707:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:3616:x1875734060782336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788839831.805717:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839831.805721:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.805730:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.805741:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553000/0xad5b343a26573e2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573e23 expref: 20 pid: 17107 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.805763:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806433:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788839831.806464:0:17100:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009209594s 00010000:00010000:0.0:1788839831.806469:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806476:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806484:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806491:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806497:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839831.806502:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806509:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806530:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839831.806540:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788839831.806558:0:17129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839831.806571:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839831.806578:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647959a00/0xad5b343a26573ed2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839831.806593:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:3616:x1875734060782336:12345-0@lo:103:ldlm_bl.0 Request processed in 885us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839831.806602:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839831.806655:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060782336:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788839831.809526:0:18616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788839831.818524:0:18616:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788839831.818533:0:18616:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788839831.818567:0:18616:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788839831.818610:0:18616:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788839831.818628:0:18616:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788839831.818654:0:18616:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788839831.819494:0:18616:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839831.819707:0:18616:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839832.001563:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788839832.849508:0:18697:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839832.849749:0:18697:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788839832.959462:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839832.959486:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060782464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839832.959558:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839832.961589:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060782592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839832.961658:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839832.961714:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782464 00000100:00100000:1.0:1788839832.961722:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782464 00000100:00100000:1.0:1788839832.961764:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782592 00000100:00100000:1.0:1788839832.961797:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782592 00000100:00100000:1.0:1788839832.961818:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839832.961827:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060782464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839832.961858:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788839832.961906:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060782464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839832.961914:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788839832.961934:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839832.961940:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060782592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839832.961961:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839832.961989:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060782592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839832.961994:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788839832.962033:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060782592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839832.962048:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060782464:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788839833.022977:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788839833.279473:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788839833.279481:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7479d8000 from 9 10000000:01000000:3.0:1788839833.279485:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839833.279528:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.279540:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.279562:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839833.279587:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060782720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839833.279645:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839833.279684:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839833.279743:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782720 00000100:00100000:2.0:1788839833.279751:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782720 00000100:00100000:2.0:1788839833.280152:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788839833.280163:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+19:17110:x1875734060782720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839833.280176:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839833.280191:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573ed9 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839833.280215:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 20 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839833.280238:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 20 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839833.280248:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647842600, rc 0) 00000100:00100000:2.0:1788839833.280296:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:17110:x1875734060782720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839833.280303:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788839833.283297:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060782720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839833.283327:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.283340:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839833.283420:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060782848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788839833.283483:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839833.283528:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839833.283590:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782848 00000100:00100000:0.0:1788839833.283597:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782848 00000100:00100000:0.0:1788839833.283646:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788839833.283654:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:17110:x1875734060782848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788839833.283674:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788839833.283693:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788839833.283696:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788839833.283816:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:17110:x1875734060782848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839833.283825:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788839833.284253:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060782848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788839833.284320:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839833.284330:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.284340:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839833.284349:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788839833.284352:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab64817e800 from 9 10000000:01000000:3.0:1788839833.284361:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839833.284397:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.284406:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.284415:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839833.284430:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060782976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839833.284460:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839833.284491:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839833.284666:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060782976 00000100:00100000:0.0:1788839833.284672:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060782976 00000100:00100000:0.0:1788839833.284714:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788839833.284722:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:17110:x1875734060782976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839833.284733:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839833.284745:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573ee7 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839833.284802:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 21 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839833.284814:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 21 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839833.284823:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfca00, rc 0) 00000100:00100000:0.0:1788839833.284862:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060782976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839833.284877:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788839833.285230:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060782976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839833.285244:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.285252:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839833.285300:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060783104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788839833.285332:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839833.285359:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a78000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839833.285471:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783104 00000100:00100000:2.0:1788839833.285476:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783104 00000100:00100000:2.0:1788839833.285512:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788839833.285519:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060783104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788839833.285534:0:17108:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788839833.285549:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788839833.285552:0:17108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788839833.285632:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060783104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839833.285639:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788839833.286956:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060783104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788839833.287048:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839833.287059:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839833.287080:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839834.048323:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839835.071252:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839835.456574:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788839836.095482:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788839837.055039:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839837.055046:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839837.055049:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839837.055052:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839837.055079:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839837.055083:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839837.055086:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839837.055089:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788839837.055142:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060783360:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055209:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055256:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060783872:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055285:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055311:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788839837.055317:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060783232:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055344:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055365:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060783744:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055384:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055410:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060783488:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055521:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055540:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060784000:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055564:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055580:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839837.055586:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060783616:0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055607:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839837.055638:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783360 00000100:00100000:3.0:1788839837.055644:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783360 00000100:00100000:3.0:1788839837.055685:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783616 00000100:00100000:3.0:1788839837.055688:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783616 00000100:00100000:3.0:1788839837.055703:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839837.055711:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060783360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055792:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060783360:12345-0@lo:400:kworker.0 Request processed in 80us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.055799:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839837.055818:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839837.055904:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060783616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.055941:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060783616:12345-0@lo:400:kworker.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.055947:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788839837.055966:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783872 00000100:00100000:3.0:1788839837.055970:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783872 00000100:00100000:3.0:1788839837.055996:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783744 00000100:00100000:3.0:1788839837.055999:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783744 00000100:00100000:3.0:1788839837.056009:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783488 00000100:00100000:3.0:1788839837.056011:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783488 00000100:00100000:3.0:1788839837.056021:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784000 00000100:00100000:3.0:1788839837.056023:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784000 00000100:00100000:3.0:1788839837.056050:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839837.056056:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060783872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.056087:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060783872:12345-0@lo:400:kworker.0 Request processed in 31us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.056093:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788839837.056104:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839837.056110:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060783744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.056134:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060783744:12345-0@lo:400:kworker.0 Request processed in 25us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.056139:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839837.056152:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839837.056158:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060783488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.056183:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060783488:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.056189:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839837.056199:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839837.056204:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060784000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.056229:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060784000:12345-0@lo:400:kworker.0 Request processed in 25us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.056234:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788839837.056254:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060783232 00000100:00100000:3.0:1788839837.056257:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060783232 00000100:00100000:3.0:1788839837.056281:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788839837.056287:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3617:x1875734060783232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839837.056315:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3617:x1875734060783232:12345-0@lo:400:kworker.0 Request processed in 28us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839837.056327:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788839837.056395:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060783616:0@lo:400:kworker.0 00010000:00080000:3.0:1788839837.056409:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a49500 x1875734060783488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839837.056420:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060783488:0@lo:400:kworker.0 00000100:00080000:1.0:1788839837.056562:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839837.056566:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839837.056748:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060783232:0@lo:400:kworker.0 00010000:00080000:2.0:1788839837.056782:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a4b100 x1875734060783744/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839837.056793:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060783744:0@lo:400:kworker.0 00000100:00100000:2.0:1788839837.056805:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060783360:0@lo:400:kworker.0 00010000:00080000:2.0:1788839837.056819:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a4b800 x1875734060783872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839837.056920:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060783872:0@lo:400:kworker.0 00010000:00080000:3.0:1788839837.057206:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a48a80 x1875734060784000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839853 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839837.057217:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060784000:0@lo:400:kworker.0 00010000:00010000:0.0:1788839837.126892:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839838.083392:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060784128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839838.083465:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839838.083568:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784128 00000100:00100000:0.0:1788839838.083578:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784128 00000100:00100000:0.0:1788839838.083633:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839838.083651:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060784128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839838.083691:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788839838.083740:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060784128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839838.083747:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788839838.083822:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060784128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839838.090188:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839838.095487:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060784256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839838.095566:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839838.095682:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784256 00000100:00100000:2.0:1788839838.095689:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784256 00000100:00100000:2.0:1788839838.095734:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839838.095742:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060784256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788839838.095803:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788839838.095852:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060784256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839838.095860:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788839838.096057:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060784256:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788839838.143866:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839838.156244:0:18987:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:0.0:1788839839.055493:0:19039:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788839839.055767:0:19039:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839839.168264:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839839.182420:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788839839.897106:0:19089:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788839839.897356:0:19089:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788839840.191681:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839841.216085:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839842.048970:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839827/real 1788839827] req@ffff8ab777ca8380 x1875734060777216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839842 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839842.049002:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777ca8380 x1875734060777216/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839842 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839842.049012:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839827/real 1788839827] req@ffff8ab777cab480 x1875734060777344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839842 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839842.049025:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777cab480 x1875734060777344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839842 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839842.049046:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839842.049062:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839842.049066:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060777216:0@lo:8:kworker.0 00000100:00080000:2.0:1788839842.049080:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788839842.049084:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788839842.049087:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060777344:0@lo:8:kworker.0 00000100:00080000:2.0:1788839842.049174:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839842.049178:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839842.049181:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839842.049184:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788839842.049197:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839842.049200:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788839842.049202:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839842.049206:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 482 00000100:00080000:2.0:1788839842.049211:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788839842.049217:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8ab648168000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839842.049236:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819fad80 x1875734060784896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839842.049247:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839842.049250:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788839842.049252:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839842.049256:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 482 00000100:00080000:2.0:1788839842.049258:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788839842.049261:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab646b66800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839842.049271:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab7819fa680 x1875734060785024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839842.049325:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060784768:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.049384:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839842.049427:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788839842.049435:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060784384:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.049462:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839842.049480:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060785152:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.049502:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839842.049535:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785152 00000100:00100000:2.0:1788839842.049538:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060784512:0@lo:400:kworker.0 00000100:00100000:3.0:1788839842.049546:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785152 00000100:00100000:2.0:1788839842.049564:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839842.049583:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060785280:0@lo:400:kworker.0 00000100:00100000:3.0:1788839842.049601:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839842.049606:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839842.049624:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788839842.049630:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060784640:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.049647:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839842.049659:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060785408:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.049680:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839842.049694:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060785152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.049697:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784768 00000100:00100000:2.0:1788839842.049702:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784768 00000100:00100000:3.0:1788839842.049791:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060785152:12345-0@lo:400:kworker.0 Request processed in 179us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839842.049799:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788839842.049816:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785280 00000100:00100000:3.0:1788839842.049820:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785280 00000100:00100000:3.0:1788839842.049849:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784640 00000100:00100000:3.0:1788839842.049852:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784640 00000100:00100000:3.0:1788839842.049863:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785408 00000100:00100000:3.0:1788839842.049865:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785408 00000100:00100000:3.0:1788839842.049879:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839842.049892:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060785280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839842.049928:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060785280:12345-0@lo:400:kworker.0 Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839842.049935:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839842.049947:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839842.049952:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060784640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839842.049979:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060784640:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839842.049985:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788839842.049996:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788839842.050002:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060785408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839842.050033:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060785408:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839842.050040:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788839842.050094:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819fbb80 x1875734060784640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839842.050106:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060784640:0@lo:400:kworker.0 00000100:00080000:1.0:1788839842.050111:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839842.050117:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788839842.050120:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a49880 x1875734060785408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839842.050131:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060785408:0@lo:400:kworker.0 00010000:00080000:3.0:1788839842.050142:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a49500 x1875734060785280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839842.050151:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060785280:0@lo:400:kworker.0 00010000:00080000:3.0:1788839842.050208:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab781a48a80 x1875734060785152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839842.050217:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060785152:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.050427:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784512 00000100:00100000:2.0:1788839842.050432:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784512 00000100:00100000:2.0:1788839842.050450:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839842.050456:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060784768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.050521:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060784768:12345-0@lo:400:kworker.0 Request processed in 63us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839842.050528:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788839842.050535:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060784768:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.050555:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839842.050562:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060784512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.050601:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060784512:12345-0@lo:400:kworker.0 Request processed in 39us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839842.050607:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839842.050634:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060784896:0@lo:8:kworker.0 00000100:00100000:2.0:1788839842.050660:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839842.050680:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060785024:0@lo:8:kworker.0 00000100:00100000:3.0:1788839842.050698:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060784512:0@lo:400:kworker.0 00000100:00100000:2.0:1788839842.050706:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839842.051577:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784384 00000100:00100000:0.0:1788839842.051585:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784384 00000100:00100000:0.0:1788839842.051617:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788839842.051625:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3616:x1875734060784384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839842.051675:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3616:x1875734060784384:12345-0@lo:400:kworker.0 Request processed in 50us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839842.051682:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788839842.051744:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060784896 00000100:00100000:0.0:1788839842.051749:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060784896 00000100:00100000:0.0:1788839842.051763:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785024 00000100:00100000:0.0:1788839842.051766:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785024 00000100:00100000:0.0:1788839842.051800:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839842.051805:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060784896:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788839842.051833:0:18620:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1788839842.051863:0:18620:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573ef5 00002000:00100000:0.0:1788839842.051876:0:18620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8ab64663f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788839842.051892:0:18620:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1788839842.051896:0:18620:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788839842.052090:0:18620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788839842.052112:0:18620:0:(import.c:65:import_set_state_nolock()) ffff8ab64663e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839842.052287:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060784896:12345-0@lo:8:kworker.0 Request processed in 480us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839842.052294:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788839842.052308:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788839842.052312:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060785024:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788839842.052324:0:18620:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788839842.063255:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060784384:0@lo:400:kworker.0 00010000:00080000:0.0:1788839842.075409:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab7819fad80 x1875734060784896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839842.075639:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788839842.075651:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788839842.075661:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788839842.075667:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788839842.075670:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab648168000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788839842.075702:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788839842.075709:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060784896:0@lo:8:kworker.0 00000004:00080000:1.0:1788839842.076075:0:17856:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788839842.076109:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875734060785664:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788839842.076335:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839842.076367:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6410b03c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788839842.076383:0:17855:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788839842.076573:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839842.076586:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060785536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839842.076618:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788839842.077085:0:17855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 497021314110ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788839842.077093:0:17855:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788839842.077256:0:18622:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788839842.077264:0:18622:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788839842.077795:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875734060785024:12345-0@lo:8:kworker.0 Request processed in 25456us (27064us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788839842.077807:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839842.078249:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785536 00000100:00100000:2.0:1788839842.078259:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785536 00000100:00100000:2.0:1788839842.078379:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788839842.078390:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1875734060785536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839842.078417:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788839842.078466:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1875734060785536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (1846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839842.078471:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788839842.078550:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788839842.078557:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788839842.078562:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060785024:0@lo:8:kworker.0 00000100:00080000:2.0:1788839842.078604:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788839842.078608:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647bb5500 x1875734060785536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839842.078630:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060785536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788839842.078657:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785664 00000100:00100000:0.0:1788839842.078662:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785664 00000100:00100000:0.0:1788839842.078695:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839842.078703:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17856:x1875734060785664:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788839842.082245:0:17847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788839842.083233:0:18620:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788839842.083240:0:18620:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788839842.086444:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17856:x1875734060785664:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7733us (10099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839842.086459:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788839842.090324:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647bb5c00 x1875734060785664/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839858 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839842.090342:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875734060785664:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788839842.090357:0:17856:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788839842.091040:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875734060785792:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788839842.091227:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839842.091271:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839842.091346:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785792 00000100:00100000:1.0:1788839842.091352:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785792 00000100:00100000:1.0:1788839842.091405:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788839842.091415:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1875734060785792:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788839842.091441:0:18621:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788839842.091482:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17856:x1875734060785792:12345-0@lo:5:osp-pre-0-1.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839842.091489:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788839842.091562:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777eef100 x1875734060785792/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839858 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839842.091573:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875734060785792:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788839842.091581:0:17856:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788839842.091608:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875734060785920:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788839842.091629:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839842.091650:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51000 going to sleep for 11 seconds 00000100:00100000:1.0:1788839842.092053:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060785920 00000100:00100000:1.0:1788839842.092058:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060785920 00000100:00100000:1.0:1788839842.092091:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788839842.092947:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17856:x1875734060785920:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788839842.093000:0:18620:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1788839842.120644:0:18617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788839842.120659:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788839842.121045:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17856:x1875734060785920:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28943us (29410us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788839842.121062:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788839842.121136:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777eef100 x1875734060785920/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839858 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839842.121149:0:17856:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788839842.121155:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17856:1875734060785920:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788839842.121170:0:17856:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1788839842.121221:0:17856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17856:1875734060786048:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788839842.121257:0:17856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839842.123048:0:17856:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51000 going to sleep for 11 seconds 00000100:00100000:3.0:1788839842.123286:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786048 00000100:00100000:3.0:1788839842.123294:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786048 00000100:00100000:3.0:1788839842.123348:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788839842.123358:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17856:x1875734060786048:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788839842.123430:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17856:x1875734060786048:12345-0@lo:900:osp-pre-0-1.0 Request processed in 73us (2172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839842.123437:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788839842.123555:0:17856:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab777eef100 x1875734060786048/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839858 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839842.123569:0:17856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17856:1875734060786048:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788839842.239984:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839843.199554:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060786176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839843.199558:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060786304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839843.202057:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839843.203008:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786176 00000100:00100000:2.0:1788839843.203017:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786176 00000100:00100000:2.0:1788839843.203067:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839843.203075:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060786176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788839843.203108:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788839843.203171:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060786176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839843.203177:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839843.203835:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060786176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839843.204875:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839843.205074:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786304 00000100:00100000:1.0:1788839843.205082:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786304 00000100:00100000:1.0:1788839843.205135:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788839843.205144:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060786304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839843.205175:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788839843.205233:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060786304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839843.205240:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788839843.205401:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060786304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788839843.262961:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839844.293857:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839845.312136:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839845.704494:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1788839845.842059:0:19435:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788839845.842063:0:19435:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788839845.842064:0:19435:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788839845.842173:0:19435:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab778bee800 00000020:01000004:1.0:1788839845.842189:0:19435:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788839845.842202:0:19435:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788839845.842216:0:19435:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab77e4f8000) 00000020:00000080:1.0:1788839845.842234:0:19435:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788839845.927412:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788839845.934816:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788839845.935134:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788839845.935786:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788839845.935999:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788839845.936247:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788839845.937511:0:19435:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788839845.939667:0:19435:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788839845.939977:0:19435:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788839845.939990:0:19435:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788839845.940001:0:19435:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xad5b343a26573f03 00000020:01000004:3.0:1788839845.940007:0:19435:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788839845.940027:0:19435:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788839845.940030:0:19435:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788839845.940035:0:19435:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788839845.940061:0:19435:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788839845.940065:0:19435:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788839845.970258:0:19435:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788839845.970300:0:19435:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788839845.970304:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788839845.970306:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839845.970307:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839845.970308:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839845.970309:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839845.970311:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839845.970312:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839845.970318:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839845.970320:0:19435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839845.970323:0:19435:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788839845.970325:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788839845.970327:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839845.970327:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839845.970328:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839845.970329:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839845.970330:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839845.970331:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839845.970333:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839845.970334:0:19435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788839845.970357:0:19435:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788839845.970376:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788839845.970436:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.970537:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777d79300 going to sleep for 11 seconds 00000100:00100000:3.0:1788839845.970986:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786432 00000100:00100000:3.0:1788839845.970993:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786432 00000100:00100000:3.0:1788839845.971094:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788839845.971104:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:19435:x1875734060786432:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788839845.971160:0:17108:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788839845.971163:0:17108:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788839845.971167:0:17108:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788839845.971573:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:19435:x1875734060786432:12345-0@lo:253:mount.lustre.0 Request processed in 469us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839845.971581:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788839845.971656:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786432:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788839845.971667:0:19435:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788839845.971669:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788839845.971670:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788839845.971671:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788839845.971673:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788839845.971674:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788839845.971675:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788839845.971676:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788839845.971678:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788839845.971679:0:19435:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788839845.971715:0:19435:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab778bee800 from lustre-OST0001 10000000:01000000:1.0:1788839845.971741:0:19435:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788839845.971744:0:19435:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788839845.971753:0:19435:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab777fb4d28 local copy 00010000:00010000:1.0:1788839845.971762:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839845.971871:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839845.971904:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.973679:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839845.974305:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786560 00000100:00100000:0.0:1788839845.974315:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786560 00000100:00100000:0.0:1788839845.974366:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788839845.974377:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:19435:x1875734060786560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839845.974496:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:19435:x1875734060786560:12345-0@lo:501:mount.lustre.0 Request processed in 120us (2591us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839845.974503:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788839845.974602:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786560:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788839845.974625:0:19435:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788839845.974647:0:19435:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788839845.974655:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839845.974665:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553e00/0xad5b343a26573c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573c24 expref: -99 pid: 17092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839845.974712:0:19435:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab778bee800 10000000:01000000:1.0:1788839845.974718:0:19435:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788839845.974723:0:19435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788839845.974726:0:19435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788839845.974730:0:19435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788839845.974732:0:19435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788839845.974757:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839845.974764:0:19435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839845.974810:0:19435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839845.974830:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788839845.974863:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.974896:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766dd300 going to sleep for 11 seconds 00000100:00100000:0.0:1788839845.975046:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786688 00000100:00100000:0.0:1788839845.975051:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786688 00000100:00100000:0.0:1788839845.975070:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788839845.975086:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:19435:x1875734060786688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788839845.975094:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839845.975106:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647bfda00/0xad5b343a26573f11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573f0a expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839845.975126:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647bfda00/0xad5b343a26573f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573f0a expref: 22 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839845.975136:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647bfda00/0xad5b343a26573f11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573f0a expref: 22 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839845.975145:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647bfda00, rc 0) 00000100:00100000:0.0:1788839845.975181:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060786688:12345-0@lo:101:mount.lustre.0 Request processed in 105us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839845.975195:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788839845.975397:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786688:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788839845.975408:0:19435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839845.975417:0:19435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839845.978531:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788839845.979400:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788839845.982758:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788839845.982890:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788839845.982904:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788839845.982916:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788839845.982928:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788839845.982941:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788839845.982963:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788839845.982968:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788839845.983056:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839845.983289:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.983377:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839845.983455:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786816 00000100:00100000:2.0:1788839845.983462:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786816 00000100:00100000:0.0:1788839845.984052:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788839845.984065:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060786816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788839845.984412:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060786816:12345-0@lo:501:mount.lustre.0 Request processed in 350us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839845.984420:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788839845.984515:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786816:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839845.984553:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839845.984594:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.984626:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839845.984669:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060786944 00000100:00100000:3.0:1788839845.984674:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060786944 00000100:00100000:3.0:1788839845.984728:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788839845.984736:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060786944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839845.985536:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060786944:12345-0@lo:503:mount.lustre.0 Request processed in 798us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839845.985546:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788839845.985623:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060786944:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839845.986124:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839845.986612:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787072:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839845.986666:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.986705:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839845.987352:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787072 00000100:00100000:2.0:1788839845.987360:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787072 00000100:00100000:2.0:1788839845.987412:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788839845.987422:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060787072:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839845.988326:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060787072:12345-0@lo:502:mount.lustre.0 Request processed in 902us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839845.988335:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788839845.988484:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839845.988708:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788839845.988740:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788839845.988756:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788839845.988803:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788839845.988822:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788839845.988836:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788839845.988851:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788839845.988866:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788839845.988880:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788839845.988923:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839845.988967:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839845.989354:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839845.990607:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787200 00000100:00100000:2.0:1788839845.990620:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787200 00000100:00100000:2.0:1788839845.990960:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788839845.990972:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060787200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839845.991315:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060787200:12345-0@lo:502:mount.lustre.0 Request processed in 345us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839845.991324:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788839845.991446:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839845.991522:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788839845.991536:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788839845.993476:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788839845.993486:0:19439:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788839845.993499:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839845.993502:0:19439:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788839845.993509:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788839845.993523:0:19439:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab646690000) 00000020:00000080:3.0:1788839845.993548:0:19439:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788839845.993555:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788839845.993630:0:19439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab778bee800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788839845.993640:0:19439:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788839845.993647:0:19439:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xad5b343a26573f1f 00010000:00010000:2.0:1788839846.003288:0:19439:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788839846.003930:0:19439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788839846.005534:0:19439:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788839846.010647:0:19439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788839846.010660:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839846.010667:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839846.010669:0:19439:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788839846.010672:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839846.010676:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839846.010677:0:19439:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788839846.010705:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788839846.010708:0:19439:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788839846.010710:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839846.010712:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839846.010713:0:19439:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788839846.010716:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788839846.010718:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839846.010719:0:19439:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788839846.010722:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788839846.010754:0:19439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788839846.010756:0:19439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788839846.010757:0:19439:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788839846.010760:0:19439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788839846.013111:0:19435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788839846.013151:0:19435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788839846.013168:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.013190:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647958600/0xad5b343a26573f0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f11 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839846.013198:0:19435:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab778bee800 from 1 10000000:01000000:3.0:1788839846.013201:0:19435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788839846.013236:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.013245:0:19435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.013266:0:19435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.013292:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787328:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788839846.013362:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.013397:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77668a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788839846.015372:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787328 00000100:00100000:3.0:1788839846.015385:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787328 00000100:00100000:3.0:1788839846.015447:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788839846.015458:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:19435:x1875734060787328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839846.015475:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839846.015493:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573f26 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.015525:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573f26 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.015536:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573f26 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.015545:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552000, rc 0) 00000100:00100000:3.0:1788839846.015619:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787328:12345-0@lo:101:mount.lustre.0 Request processed in 163us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.015626:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788839846.015695:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787328:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788839846.015725:0:19435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.015754:0:19435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839846.017941:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788839846.020470:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839846.021945:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788839846.021984:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788839846.022003:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788839846.022008:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788839846.022285:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839846.022343:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.023351:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77668ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.026143:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787456 00000100:00100000:2.0:1788839846.026155:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787456 00000100:00100000:3.0:1788839846.026403:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788839846.026413:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839846.026587:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787456:12345-0@lo:501:mount.lustre.0 Request processed in 175us (4242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.026594:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788839846.026721:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787456:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788839846.026804:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787584:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788839846.026855:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839846.026885:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.027352:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787584 00000100:00100000:2.0:1788839846.027358:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787584 00000100:00100000:2.0:1788839846.027395:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788839846.027404:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839846.027503:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787584:12345-0@lo:503:mount.lustre.0 Request processed in 100us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.027510:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788839846.027624:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787584:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788839846.028048:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788839846.028124:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787712:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839846.028163:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839846.028399:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.028459:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787712 00000100:00100000:2.0:1788839846.028465:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787712 00000100:00100000:2.0:1788839846.028499:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788839846.028506:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839846.028590:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787712:12345-0@lo:502:mount.lustre.0 Request processed in 84us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.028597:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788839846.028763:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787712:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839846.028952:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788839846.028976:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788839846.028990:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788839846.029002:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788839846.029014:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788839846.029027:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788839846.029039:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788839846.029051:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788839846.029063:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788839846.029088:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788839846.029102:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788839846.029122:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787840:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788839846.029156:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839846.029175:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.029362:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787840 00000100:00100000:2.0:1788839846.029373:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787840 00000100:00100000:2.0:1788839846.029406:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788839846.029413:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788839846.029491:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787840:12345-0@lo:502:mount.lustre.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.029499:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788839846.029610:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788839846.029647:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:1.0:1788839846.029654:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788839846.031856:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839846.031867:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.031870:0:19443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788839846.031876:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab778bee800 00000020:00000080:3.0:1788839846.031879:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788839846.031886:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839846.031889:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.031890:0:19443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788839846.031893:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839846.031895:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.031896:0:19443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788839846.031910:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab778bee800 00000020:00000080:3.0:1788839846.031912:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788839846.032147:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839846.032152:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.032153:0:19443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788839846.032156:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839846.032159:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.032161:0:19443:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788839846.032164:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab778bee800 00000020:00000080:3.0:1788839846.032167:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788839846.035947:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839846.035959:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.035962:0:19443:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788839846.035966:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788839846.035971:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.035973:0:19443:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788839846.035978:0:19443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab778bee800 00000020:00000080:3.0:1788839846.035980:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788839846.036042:0:19443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788839846.036046:0:19443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788839846.036047:0:19443:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788839846.036051:0:19443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788839846.036344:0:19435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788839846.036373:0:19435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839846.036395:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036407:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788839846.036464:0:19435:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788839846.036467:0:19435:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8ab778bee800 10000000:01000000:2.0:1788839846.036470:0:19435:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab778bee800 10000000:01000000:2.0:1788839846.036474:0:19435:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788839846.036480:0:19435:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8ab778bee800 from 1 10000000:01000000:2.0:1788839846.036482:0:19435:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788839846.036513:0:19435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036522:0:19435:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036533:0:19435:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839846.036556:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788839846.036629:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839846.036670:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060787968 00000100:00100000:2.0:1788839846.036676:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060787968 00000100:00100000:2.0:1788839846.036737:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839846.036746:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:19435:x1875734060787968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839846.036758:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839846.036788:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843600/0xad5b343a26573f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573f34 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036811:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843600/0xad5b343a26573f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573f34 expref: 24 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036821:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843600/0xad5b343a26573f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573f34 expref: 24 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036830:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843600, rc 0) 00000100:00100000:2.0:1788839846.036862:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060787968:12345-0@lo:101:mount.lustre.0 Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.036869:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788839846.036910:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760dba300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.036933:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060787968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788839846.036946:0:19435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.036955:0:19435:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788839846.040799:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788839846.041173:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839846.042340:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788839846.042372:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788839846.042385:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788839846.042398:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788839846.042410:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788839846.042420:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788839846.042434:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788839846.042447:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788839846.042459:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788839846.042472:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788839846.042485:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788839846.042506:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788839846.042520:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788839846.042532:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788839846.042545:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788839846.042559:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788839846.042573:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788839846.042586:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788839846.042598:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788839846.042609:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788839846.042623:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788839846.042637:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788839846.042651:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788839846.042663:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788839846.042673:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788839846.042762:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788839846.042862:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788839846.042892:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788839846.042906:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788839846.042919:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788839846.042933:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788839846.042946:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788839846.042958:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788839846.042970:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788839846.042981:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788839846.042991:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788839846.043003:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788839846.043015:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788839846.043028:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788839846.043042:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788839846.043057:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788839846.043071:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788839846.046949:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788839846.046994:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788839846.047019:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788839846.047034:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788839846.047061:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788839846.047067:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788839846.047306:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839846.047373:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.047418:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6410b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.050207:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788096 00000100:00100000:2.0:1788839846.050222:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788096 00000100:00100000:2.0:1788839846.050284:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788839846.050294:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788839846.050452:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788096:12345-0@lo:501:mount.lustre.0 Request processed in 160us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.050460:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788839846.050620:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788839846.050666:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788839846.050855:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.050887:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6410b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.051269:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788224 00000100:00100000:2.0:1788839846.051274:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788224 00000100:00100000:2.0:1788839846.053810:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788839846.053830:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788224:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788839846.053981:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788224:12345-0@lo:503:mount.lustre.0 Request processed in 158us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.053989:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788839846.061872:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788224:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788839846.062308:0:19435:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788839846.062390:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839846.062460:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.062507:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788352 00000100:00100000:3.0:1788839846.062513:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788352 00000100:00100000:3.0:1788839846.062554:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788839846.062564:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839846.062667:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788352:12345-0@lo:502:mount.lustre.0 Request processed in 104us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.062675:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788839846.063840:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e59c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839846.063862:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839846.064023:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788839846.064053:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788839846.064064:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788839846.064087:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788839846.064100:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788839846.064111:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788839846.064121:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788839846.064132:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788839846.064143:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788839846.064164:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788839846.064176:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788839846.064307:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788839846.064324:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788839846.064337:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788839846.064351:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788839846.064361:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788839846.064372:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788839846.064382:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788839846.064393:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788839846.064403:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788839846.064413:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788839846.064424:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788839846.064434:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788839846.064445:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788839846.064456:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788839846.064477:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788839846.064489:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788839846.064499:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788839846.064510:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788839846.064521:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788839846.064531:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788839846.064541:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788839846.064552:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788839846.064563:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788839846.064584:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788839846.064598:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788839846.064609:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788839846.064622:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788839846.064634:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788839846.064648:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788839846.064660:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788839846.064751:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788839846.064768:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788839846.064799:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788839846.064810:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788839846.064820:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788839846.064831:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788839846.064841:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788839846.064877:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839846.064930:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.064964:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788480 00000100:00100000:3.0:1788839846.064969:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788480 00000100:00100000:3.0:1788839846.064998:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788839846.065004:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788480:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839846.065144:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788480:12345-0@lo:502:mount.lustre.0 Request processed in 139us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.065152:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788839846.065764:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e59c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839846.065810:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839846.065979:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788839846.066000:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788839846.066022:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788608:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839846.066059:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.067244:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788608 00000100:00100000:3.0:1788839846.067253:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788608 00000100:00100000:3.0:1788839846.067295:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839846.067303:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788839846.067400:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060788608:12345-0@lo:502:mount.lustre.0 Request processed in 98us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.067407:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788839846.067450:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e59c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788839846.067465:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060788608:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788839846.067515:0:19435:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788839846.067526:0:19435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788839846.075923:0:19448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788839846.075949:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab641944d28) 00000020:00000080:2.0:1788839846.075976:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788839846.076070:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab778bee800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839846.076143:0:19448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab778bee800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839846.076146:0:19448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab778bee800 3 00010000:00080000:2.0:1788839846.076174:0:19448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab6475ac000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839846.081036:0:19448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788839846.081275:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788839846.081323:0:19448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839846.081336:0:19448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xad5b343a26573f49 00000100:00080000:2.0:1788839846.081347:0:19448:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839846.081352:0:19448:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab6475ac000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839846.081401:0:19448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6478ae300 x1875734060788736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839846.081443:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060788736:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788839846.081513:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788839846.081576:0:19448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788839846.081676:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788736 00000100:00100000:3.0:1788839846.081684:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788736 00000100:00100000:3.0:1788839846.081733:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839846.081741:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875734060788736:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788839846.081767:0:17115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:3.0:1788839846.081818:0:17115:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xad5b343a26573f50 00000004:00100000:3.0:1788839846.081833:0:17115:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788839846.081863:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8ab647a03800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839846.081914:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875734060788736:12345-0@lo:38:llog_process_th.0 Request processed in 172us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.081922:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788839846.081964:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839846.081968:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839846.081971:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839846.081974:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839846.082012:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839846.082015:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788839846.082017:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788839846.082022:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:3.0:1788839846.082025:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788839846.082029:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab646b66800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1788839846.082042:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab647af6a00 x1875734060789376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788839846.082196:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060789376:0@lo:8:kworker.0 00000100:00100000:3.0:1788839846.082225:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788839846.082264:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6478ae300 x1875734060788736/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839846.082274:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839846.082281:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788839846.082287:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788839846.082291:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788839846.082293:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab6475ac000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788839846.082298:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875734060788736:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839846.082323:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060788864:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082350:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082369:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060789504:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082404:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082422:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788839846.082428:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060789248:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082459:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082489:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060788992:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082511:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060789632:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082563:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788839846.082568:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060789120:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082589:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082606:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060789760:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.082625:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.082647:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789376 00000100:00100000:3.0:1788839846.082651:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789376 00000100:00100000:3.0:1788839846.082671:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789248 00000100:00100000:3.0:1788839846.082673:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789248 00000100:00100000:2.0:1788839846.082975:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789504 00000100:00100000:2.0:1788839846.082980:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789504 00000100:00100000:2.0:1788839846.083000:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788992 00000100:00100000:2.0:1788839846.083003:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788992 00000100:00100000:2.0:1788839846.083014:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789632 00000100:00100000:2.0:1788839846.083017:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789632 00000100:00100000:2.0:1788839846.083032:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789760 00000100:00100000:2.0:1788839846.083035:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789760 00000100:00100000:2.0:1788839846.083050:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839846.083057:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060789504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.083569:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839846.083580:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060789248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.083630:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060789248:12345-0@lo:400:kworker.0 Request processed in 54us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.083637:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788839846.083652:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839846.083657:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875734060789376:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788839846.083721:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875734060789376:12345-0@lo:8:kworker.0 Request processed in 62us (1494us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788839846.083728:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788839846.083745:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060788864 00000100:00100000:3.0:1788839846.083749:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060788864 00000100:00100000:3.0:1788839846.083804:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789120 00000100:00100000:3.0:1788839846.083807:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789120 00000100:00100000:3.0:1788839846.083820:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839846.083826:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060788864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.083856:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060788864:12345-0@lo:400:kworker.0 Request processed in 31us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.083862:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788839846.083872:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788839846.083877:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060789120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.083904:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060789120:12345-0@lo:400:kworker.0 Request processed in 27us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.083910:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788839846.083928:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839846.083934:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060788992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.083961:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060788992:12345-0@lo:400:kworker.0 Request processed in 27us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.083967:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839846.083981:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839846.083987:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060789632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.084012:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060789632:12345-0@lo:400:kworker.0 Request processed in 26us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.084017:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788839846.084029:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839846.084036:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060789760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.084060:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875734060789760:12345-0@lo:400:kworker.0 Request processed in 25us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.084253:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788839846.084290:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788839846.084294:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839846.084296:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788839846.084324:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647af6680 x1875734060789248/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839846.084337:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060789248:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.084351:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060788864:0@lo:400:kworker.0 00000100:00100000:3.0:1788839846.084385:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788839846.084391:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839846.084396:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788839846.084399:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060789376:0@lo:8:kworker.0 00000100:00100000:3.0:1788839846.084426:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060789120:0@lo:400:kworker.0 00010000:00080000:3.0:1788839846.084437:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647af5180 x1875734060789760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839846.084446:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875734060789760:0@lo:400:kworker.0 00010000:00080000:3.0:1788839846.084455:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647af7480 x1875734060788992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839846.084464:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060788992:0@lo:400:kworker.0 00010000:00080000:3.0:1788839846.084476:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647af4e00 x1875734060789632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839846.084484:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060789632:0@lo:400:kworker.0 00000100:00100000:2.0:1788839846.084879:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060789504:12345-0@lo:400:kworker.0 Request processed in 1821us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.084888:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000020:01000004:2.0:1788839846.084985:0:19448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788839846.084999:0:19448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8ab641940000) 00000020:00000080:2.0:1788839846.085021:0:19448:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00010000:00080000:1.0:1788839846.085191:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab647af7100 x1875734060789504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839862 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839846.085202:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060789504:0@lo:400:kworker.0 00000020:01000004:2.0:1788839846.085837:0:19448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab778bee800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839846.085842:0:19448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab778bee800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788839846.085845:0:19448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab778bee800 3 00010000:00080000:2.0:1788839846.085884:0:19448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab647519000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1788839846.089669:0:19448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788839846.091623:0:19448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788839846.091670:0:19448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788839846.091708:0:19448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xad5b343a26573f5e 00000100:00080000:2.0:1788839846.091719:0:19448:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788839846.091724:0:19448:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8ab647519000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839846.091755:0:19448:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6478aea00 x1875734060789888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839846.091793:0:19448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788839846.091906:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060789888:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788839846.091975:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839846.092110:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839846.092115:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788839846.092117:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788839846.092120:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788839846.094838:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060789888 00000100:00100000:2.0:1788839846.094849:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060789888 00000100:00100000:2.0:1788839846.094888:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839846.094896:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875734060789888:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788839846.094923:0:17114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1788839846.094970:0:17114:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xad5b343a26573f65 00000004:00100000:2.0:1788839846.094983:0:17114:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788839846.095014:0:17114:0:(import.c:65:import_set_state_nolock()) ffff8ab64751f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839846.095097:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875734060789888:12345-0@lo:38:llog_process_th.0 Request processed in 202us (3122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.095105:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1788839846.095230:0:19448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:2.0:1788839846.096845:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab6478aea00 x1875734060789888/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788839856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839846.096859:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839846.096868:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788839846.096875:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788839846.096880:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788839846.096884:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647519000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788839846.096890:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875734060789888:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788839846.099319:0:19435:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788839846.099362:0:19435:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788839846.099388:0:19435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839846.099401:0:19435:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647843e00/0xad5b343a26573f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f3b expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788839846.099459:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788839846.099461:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839846.099463:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839846.099464:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839846.099466:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839846.099467:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839846.099469:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839846.099470:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839846.099472:0:19435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839846.099475:0:19435:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788839846.099477:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788839846.099479:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839846.099480:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839846.099481:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839846.099482:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839846.099483:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839846.099484:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839846.099485:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839846.099486:0:19435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788839846.099512:0:19435:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788839846.099531:0:19435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060790016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788839846.099595:0:19435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839846.099637:0:19435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab758752c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788839846.100287:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790016 00000100:00100000:2.0:1788839846.100296:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790016 00000100:00100000:2.0:1788839846.100347:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788839846.100361:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060790016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788839846.100387:0:17107:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788839846.100399:0:17107:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788839846.109837:0:17107:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788839846.109851:0:17107:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788839846.110453:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:19435:x1875734060790016:12345-0@lo:253:mount.lustre.0 Request processed in 10088us (10852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839846.110465:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 20000000:01000000:3.0:1788839846.110556:0:17129:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788839846.110561:0:17129:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788839846.110597:0:17129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.110613:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.110621:0:17129:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.110629:0:17129:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.110667:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.110682:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 23 pid: 17107 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.110706:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060790144:0@lo:104: 00000100:00100000:3.0:1788839846.110743:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788839846.110822:0:17129:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.110830:0:17129:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 23 pid: 17108 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.110839:0:17129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060790272:0@lo:104: 00000100:00100000:3.0:1788839846.110861:0:17129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.110892:0:17129:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788839846.110960:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790144 00000100:00100000:0.0:1788839846.110968:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790144 00000100:00100000:0.0:1788839846.110997:0:17096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790272 00000100:00100000:0.0:1788839846.111000:0:17096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790272 00000100:00100000:0.0:1788839846.111013:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839846.111021:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:17129:x1875734060790144:12345-0@lo:104: 00010000:00010000:0.0:1788839846.111033:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839846.111095:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839846.111102:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:17129:x1875734060790144:12345-0@lo:104: Request processed in 82us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839846.111108:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839846.111122:0:17096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839846.111128:0:17096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060790272:12345-0@lo:104: 00010000:00010000:0.0:1788839846.111137:0:17096:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839846.111168:0:17096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788839846.111173:0:17096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:17129:x1875734060790272:12345-0@lo:104: Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839846.111317:0:19435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4b73860-6950-4a5d-8d03-52a643e5ff43:19435:1875734060790016:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788839846.111330:0:19435:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788839846.111334:0:19435:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788839846.111335:0:19435:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788839846.111337:0:19435:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788839846.111338:0:19435:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788839846.111339:0:19435:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788839846.111340:0:19435:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788839846.111342:0:19435:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788839846.111344:0:19435:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788839846.111345:0:19435:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788839846.111361:0:19435:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788839846.111496:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839846.111503:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111511:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839846.111515:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111524:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839846.111532:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839846.111538:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839846.111569:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111576:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839846.111596:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111613:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553200/0xad5b343a26573ee7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573eee expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111627:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839846.111630:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111636:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552c00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839846.111639:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111645:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839846.111652:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839846.111657:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788839846.111668:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111674:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839846.111680:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111686:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573ee0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.111712:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839846.111719:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839846.111721:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839846.111733:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060790400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839846.111846:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.111876:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788839846.111881:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060790528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839846.111900:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839846.111923:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790400 00000100:00100000:3.0:1788839846.111927:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790400 00010000:00010000:3.0:1788839846.111947:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 24 pid: 17107 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.111966:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790528 00000100:00100000:3.0:1788839846.111969:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790528 00010000:00010000:3.0:1788839846.111978:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 25 pid: 17108 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.111989:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839846.111994:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+25:3614:x1875734060790400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839846.112004:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839846.112009:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 25 pid: 17107 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112018:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 25 pid: 17107 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112032:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839846.112058:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+25:3614:x1875734060790400:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.112064:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788839846.112083:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788839846.112089:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060790528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839846.112097:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839846.112101:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 24 pid: 17108 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112110:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 24 pid: 17108 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112121:0:17098:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112129:0:17098:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788839846.112142:0:17098:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009209594s 00010000:00010000:3.0:1788839846.112146:0:17098:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112153:0:17098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112160:0:17098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112388:0:17098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112393:0:17098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839846.112397:0:17098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112414:0:17098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112424:0:17098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112435:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839846.112459:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060790528:12345-0@lo:103:ldlm_bl.0 Request processed in 370us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839846.112467:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839846.112485:0:17096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788839846.112513:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839846.112521:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfca00/0xad5b343a26573eee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573ee7 expref: 23 pid: 17107 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.112532:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060790144:0@lo:104: 00010000:00010000:3.0:1788839846.112542:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842600/0xad5b343a26573ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573ed9 expref: 22 pid: 17108 timeout: 601 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.112550:0:17129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17129:1875734060790272:0@lo:104: 00010000:00010000:3.0:1788839846.112566:0:17129:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112575:0:17129:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112581:0:17129:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839846.112587:0:17129:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e553000/0xad5b343a26573f6c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839846.112621:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060790528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839846.112627:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060790400:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788839846.128424:0:19435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788839846.144354:0:19435:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788839846.144374:0:19435:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788839846.144420:0:19435:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788839846.144663:0:19435:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788839846.144703:0:19435:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788839846.144727:0:19435:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788839846.146868:0:19435:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788839846.147485:0:19435:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788839846.335889:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788839847.280393:0:19502:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839847.280611:0:19502:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788839847.299818:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060790656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839847.299886:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839847.299927:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790656 00000100:00100000:2.0:1788839847.299936:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790656 00000100:00100000:2.0:1788839847.299990:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839847.300000:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060790656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788839847.300028:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788839847.300079:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060790656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839847.300086:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788839847.300128:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478aea00 x1875734060790656/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839847.300148:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060790656:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788839847.359465:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788839847.743836:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788839847.743844:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab7479d8000 from 10 10000000:01000000:3.0:1788839847.743850:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839847.743893:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.743906:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.743917:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839847.743942:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060790784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839847.744008:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839847.744066:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839847.746550:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790784 00000100:00100000:2.0:1788839847.746566:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790784 00000100:00100000:2.0:1788839847.746628:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788839847.746649:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060790784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839847.746667:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839847.746700:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647843800/0xad5b343a26573f7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573f73 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839847.746982:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647843800/0xad5b343a26573f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573f73 expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839847.746995:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647843800/0xad5b343a26573f7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573f73 expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839847.747005:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647843800, rc 0) 00000100:00100000:2.0:1788839847.747079:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060790784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 433us (3071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839847.747086:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788839847.747156:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060790784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839847.747175:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839847.747185:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839847.747248:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060790912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788839847.747288:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839847.747314:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7463559c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788839847.747651:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060790912 00000100:00100000:3.0:1788839847.747657:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060790912 00000100:00100000:3.0:1788839847.747701:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788839847.747710:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060790912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788839847.747737:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788839847.747755:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788839847.747758:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788839847.748033:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060790912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 324us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839847.748040:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788839847.748075:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060790912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788839847.748132:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839847.748139:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748148:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e553000/0xad5b343a26573f73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f7a expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839847.748157:0:17110:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788839847.748159:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8ab64817e800 from 10 10000000:01000000:3.0:1788839847.748162:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788839847.748183:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748190:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748198:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839847.748220:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060791040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788839847.748246:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839847.748259:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839847.748270:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791040 00000100:00100000:3.0:1788839847.748274:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791040 00000100:00100000:3.0:1788839847.748294:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788839847.748299:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060791040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839847.748306:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839847.748316:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab75e553200/0xad5b343a26573f88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a26573f81 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748331:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab75e553200/0xad5b343a26573f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a26573f81 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748339:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab75e553200/0xad5b343a26573f88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573f81 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748345:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553200, rc 0) 00000100:00100000:3.0:1788839847.748370:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060791040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839847.748376:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788839847.748403:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060791040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839847.748413:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.748421:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839847.748461:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060791168:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788839847.748486:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839847.748499:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab6478f1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788839847.748508:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791168 00000100:00100000:3.0:1788839847.748512:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791168 00000100:00100000:3.0:1788839847.749628:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788839847.749640:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060791168:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788839847.749657:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788839847.749670:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788839847.749673:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788839847.749983:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060791168:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 345us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839847.749990:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788839847.750034:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060791168:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788839847.750085:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788839847.750094:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839847.750103:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab75e552c00/0xad5b343a26573f81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a26573f88 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839848.318930:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060791296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839848.318988:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060791424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839848.319018:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839848.319992:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839848.320344:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791296 00000100:00100000:1.0:1788839848.320354:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791296 00000100:00100000:1.0:1788839848.320399:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791424 00000100:00100000:1.0:1788839848.320403:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791424 00000100:00100000:1.0:1788839848.320418:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839848.320436:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060791296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839848.320482:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839848.320542:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060791296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839848.320548:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788839848.320578:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839848.320584:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060791424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839848.320601:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788839848.320635:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060791424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839848.320641:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788839848.320694:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060791424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839848.321485:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060791296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788839848.384937:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839849.151720:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839829/real 1788839829] req@ffff8ab777eee300 x1875734060778240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839849 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.151759:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777eee300 x1875734060778240/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839849 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.151797:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788839829/real 1788839829] req@ffff8ab777eedc00 x1875734060778112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839849 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.151808:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab777eedc00 x1875734060778112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788839849 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788839849.151889:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839849.151903:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788839849.151908:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060778240:0@lo:8:kworker.0 00000100:00080000:3.0:1788839849.151913:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788839849.151918:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788839849.151921:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060778112:0@lo:8:kworker.0 00000100:00080000:2.0:1788839849.152034:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839849.152038:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788839849.152044:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839849.152049:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1788839849.152053:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788839849.152059:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab646534800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839849.152075:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6478af800 x1875734060791808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839849.152087:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839849.152090:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788839849.152092:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839849.152095:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 484 00000100:00080000:2.0:1788839849.152097:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788839849.152099:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab647a27000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839849.152107:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6478ad180 x1875734060791936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788839849.152128:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788839849.152131:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788839849.152132:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788839849.152136:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8ab646b66800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1788839849.152143:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab6478afb80 x1875734060792448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788839849.152188:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060792192:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152259:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152285:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060792832:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152305:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152328:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788839849.152333:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060791552:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152353:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152378:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060792320:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152400:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152416:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060792960:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152435:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152459:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060791680:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152479:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152493:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060792576:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152510:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152524:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060793088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152541:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152556:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788839849.152561:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060792064:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152581:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152590:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060792704:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.152626:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792192 00000100:00100000:2.0:1788839849.152633:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792192 00000100:00100000:2.0:1788839849.152670:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791680 00000100:00100000:2.0:1788839849.152673:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791680 00000100:00100000:2.0:1788839849.152699:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839849.152707:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060792192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152755:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060792192:12345-0@lo:400:kworker.0 Request processed in 48us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.152798:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839849.152816:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839849.152821:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060791680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.152853:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060791680:12345-0@lo:400:kworker.0 Request processed in 32us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.152859:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788839849.152875:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792832 00000100:00100000:2.0:1788839849.152878:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792832 00000100:00100000:2.0:1788839849.152905:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792960 00000100:00100000:2.0:1788839849.152908:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792960 00000100:00100000:2.0:1788839849.152920:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792576 00000100:00100000:2.0:1788839849.152922:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792576 00000100:00100000:2.0:1788839849.152931:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793088 00000100:00100000:2.0:1788839849.152934:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793088 00000100:00100000:2.0:1788839849.152958:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792064 00000100:00100000:2.0:1788839849.152961:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792064 00000100:00100000:2.0:1788839849.152973:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792704 00000100:00100000:2.0:1788839849.152975:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792704 00000100:00100000:2.0:1788839849.152986:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839849.152992:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060792832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153018:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060792832:12345-0@lo:400:kworker.0 Request processed in 27us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153024:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788839849.153035:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839849.153040:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060792960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153063:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060792960:12345-0@lo:400:kworker.0 Request processed in 23us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153068:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788839849.153086:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839849.153091:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060792576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153128:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060792576:12345-0@lo:400:kworker.0 Request processed in 36us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153134:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839849.153145:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839849.153150:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060793088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153171:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060793088:12345-0@lo:400:kworker.0 Request processed in 22us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153176:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839849.153200:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839849.153207:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060792064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153231:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060792064:12345-0@lo:400:kworker.0 Request processed in 25us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153237:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839849.153248:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839849.153254:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060792704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153277:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060792704:12345-0@lo:400:kworker.0 Request processed in 24us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153283:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839849.153301:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791552 00000100:00100000:2.0:1788839849.153304:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791552 00000100:00100000:2.0:1788839849.153329:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788839849.153334:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060791552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153362:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060791552:12345-0@lo:400:kworker.0 Request processed in 27us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153374:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788839849.153406:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792320 00000100:00100000:2.0:1788839849.153410:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792320 00000100:00100000:2.0:1788839849.153436:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788839849.153441:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060792320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.153468:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060792320:12345-0@lo:400:kworker.0 Request processed in 27us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153473:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788839849.153505:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839849.153509:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839849.153510:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839849.153527:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060791808:0@lo:8:kworker.0 00000100:00100000:2.0:1788839849.153551:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.153572:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060791936:0@lo:8:kworker.0 00000100:00100000:2.0:1788839849.153592:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.153607:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060792448:0@lo:8:kworker.0 00000100:00100000:2.0:1788839849.153626:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.153653:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791808 00000100:00100000:2.0:1788839849.153656:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791808 00000100:00100000:2.0:1788839849.153672:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060791936 00000100:00100000:2.0:1788839849.153686:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060791936 00000100:00100000:2.0:1788839849.153695:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060792448 00000100:00100000:2.0:1788839849.153698:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060792448 00000100:00100000:2.0:1788839849.153707:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839849.153711:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875734060791808:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788839849.153733:0:19203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:2.0:1788839849.153759:0:19203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573f8f 00002000:00100000:2.0:1788839849.153802:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab647519800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788839849.153806:0:19203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788839849.153809:0:19203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788839849.153880:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788839849.153911:0:19203:0:(import.c:65:import_set_state_nolock()) ffff8ab64751b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839849.153949:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060791808:12345-0@lo:8:kworker.0 Request processed in 236us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.153955:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788839849.153968:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839849.153972:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875734060791936:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788839849.153986:0:19203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:2.0:1788839849.154000:0:19203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xad5b343a26573f96 00002000:00100000:2.0:1788839849.154006:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab647518800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788839849.154009:0:19203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788839849.154011:0:19203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788839849.154139:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788839849.154152:0:19203:0:(import.c:65:import_set_state_nolock()) ffff8ab64751a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839849.154178:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3613:x1875734060791936:12345-0@lo:8:kworker.0 Request processed in 205us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.154184:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788839849.154194:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788839849.154198:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3613:x1875734060792448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788839849.154210:0:19203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 504 last 0 00000020:00000080:2.0:1788839849.154224:0:19203:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xad5b343a26573f9d 00002000:00100000:2.0:1788839849.154229:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8ab64751e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113973 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788839849.154240:0:19203:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788839849.154242:0:19203:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788839849.154262:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788839849.154274:0:19203:0:(import.c:65:import_set_state_nolock()) ffff8ab64751f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839849.154301:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3613:x1875734060792448:12345-0@lo:8:kworker.0 Request processed in 102us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.154308:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788839849.154354:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ad880 x1875734060792064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154367:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060792064:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154379:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ac000 x1875734060792704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154387:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060792704:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.154397:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060791680:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154407:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ac700 x1875734060792576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154414:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060792576:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154424:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d4b800 x1875734060793088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154432:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060793088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.154464:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060791552:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154475:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478adc00 x1875734060792320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154493:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060792320:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154505:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ae300 x1875734060792960/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154512:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060792960:0@lo:400:kworker.0 00000100:00100000:2.0:1788839849.154521:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060792192:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154531:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478aea00 x1875734060792832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154539:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060792832:0@lo:400:kworker.0 00010000:00080000:2.0:1788839849.154569:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478af800 x1875734060791808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154576:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839849.154582:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788839849.154588:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788839849.154593:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788839849.154595:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646534800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788839849.154606:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788839849.154610:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060791808:0@lo:8:kworker.0 00010000:00080000:2.0:1788839849.154621:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ad180 x1875734060791936/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.154628:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788839849.154632:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788839849.154636:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788839849.154645:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788839849.154647:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab647a27000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788839849.154665:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788839849.154668:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875734060791936:0@lo:8:kworker.0 00010000:00080000:2.0:1788839849.154693:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478afb80 x1875734060792448/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788839874 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788839849.154702:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788839849.154706:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788839849.154708:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788839849.154710:0:3613:0:(import.c:65:import_set_state_nolock()) ffff8ab646b66800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788839849.154726:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788839849.154730:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875734060792448:0@lo:8:kworker.0 00000004:00080000:2.0:1788839849.154797:0:17858:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788839849.154814:0:17858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875734060793344:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788839849.154837:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.154853:0:17858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74515d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788839849.154862:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839849.154868:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060793216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839849.154888:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.154908:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793216 00000100:00100000:2.0:1788839849.154912:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793216 00000100:00100000:2.0:1788839849.154943:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788839849.154949:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060793216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839849.154966:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788839849.154998:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3616:x1875734060793216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.155012:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788839849.155030:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788839849.155051:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d4b800 x1875734060793216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839849.155064:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060793216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839849.155078:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793344 00000100:00100000:2.0:1788839849.155082:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793344 00000100:00100000:2.0:1788839849.155099:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788839849.155104:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17858:x1875734060793344:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788839849.155238:0:17137:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788839849.155300:0:17137:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504099529145ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788839849.155306:0:17137:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788839849.155331:0:17139:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788839849.155373:0:17139:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 504099601670ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788839849.155377:0:17139:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788839849.155744:0:17140:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788839849.155761:0:17140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17140:1875734060793600:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788839849.155812:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839849.155826:0:17140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d94180 going to sleep for 11 seconds 00000004:00080000:1.0:1788839849.155837:0:17857:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788839849.155845:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1788839849.155883:0:17857:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 504100112012ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788839849.155887:0:17857:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788839849.155922:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060793472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839849.155952:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788839849.155985:0:17138:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788839849.155997:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17138:1875734060793856:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788839849.156017:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839849.156026:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab7766dd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788839849.156036:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060793728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839849.156051:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839849.163823:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793472 00000100:00100000:2.0:1788839849.163837:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793472 00000100:00100000:2.0:1788839849.163878:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793728 00000100:00100000:2.0:1788839849.163881:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793728 00000100:00100000:2.0:1788839849.163931:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839849.163943:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060793472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788839849.163983:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788839849.164065:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060793472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (8111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.164072:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839849.164088:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839849.164094:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060793728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839849.164109:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788839849.164135:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060793728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (8082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.164141:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788839849.164166:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793600 00000100:00100000:2.0:1788839849.164170:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793600 00000100:00100000:2.0:1788839849.164200:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793856 00000100:00100000:2.0:1788839849.164202:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793856 00000100:00100000:2.0:1788839849.164214:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839849.164219:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17140:x1875734060793600:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:3.0:1788839849.164946:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647af4700 x1875734060793728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.164980:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060793728:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788839849.164995:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab647bb5880 x1875734060793472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788839865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.165006:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060793472:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788839849.165856:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839849.165863:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788839849.181696:0:17847:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1788839849.182042:0:17093:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788839849.182057:0:17093:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788839849.182369:0:19203:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788839849.182376:0:19203:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788839849.182466:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17858:x1875734060793344:12345-0@lo:7:osp-pre-1-1.0 Request processed in 27357us (27623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839849.182477:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839849.182508:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839849.182521:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17138:x1875734060793856:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1788839849.182716:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d4bb80 x1875734060793344/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788839865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.182732:0:17858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875734060793344:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788839849.182745:0:17858:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788839849.182800:0:17858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875734060793984:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788839849.182834:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839849.182857:0:17858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74515d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839849.183907:0:18621:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788839849.183918:0:18621:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788839849.184730:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060793984 00000100:00100000:1.0:1788839849.184739:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060793984 00000100:00100000:0.0:1788839849.185141:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839849.185151:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17858:x1875734060793984:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788839849.185177:0:19600:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788839849.185564:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17858:x1875734060793984:12345-0@lo:5:osp-pre-1-1.0 Request processed in 414us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839849.185572:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788839849.185645:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb100 x1875734060793984/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788839865 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839849.185670:0:17858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875734060793984:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788839849.185694:0:17858:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788839849.185733:0:17858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875734060794112:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788839849.185762:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839849.185807:0:17858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d94b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839849.186058:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794112 00000100:00100000:0.0:1788839849.186063:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794112 00000100:00100000:0.0:1788839849.186091:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839849.186097:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17858:x1875734060794112:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788839849.186122:0:18621:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1788839849.186533:0:19203:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788839849.186544:0:19203:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788839849.186549:0:19203:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00080000:3.0:1788839849.187376:0:18622:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788839849.187383:0:18622:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788839849.187387:0:18622:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00002000:00010000:0.0:1788839849.197842:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.197856:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.197877:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.197882:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.197889:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.197912:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.197925:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.197933:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.197956:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.198178:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.198185:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.198204:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfca00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.198208:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.198218:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.198250:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.198258:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6cf806b/0xad5b343a26573fa4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.198277:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.198279:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.198280:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.199527:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.199536:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.199559:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.199563:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.199568:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.199578:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.199587:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.199594:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.199613:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839849.200869:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.200879:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.200909:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.200914:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.200932:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.200952:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.200975:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.201000:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.201029:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788839849.202928:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.202940:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.202954:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.202958:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.202964:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.202976:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.202986:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.202993:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.203030:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788839849.203185:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788839849.203193:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.203200:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.203205:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.203212:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.203227:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.203235:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002302453e/0xad5b343a26573fab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.205013:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839849.205020:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.205028:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.207730:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.207967:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208001:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208017:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a24275e0/0xad5b343a26573fb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208054:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.208059:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208076:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.208080:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208087:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208097:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208115:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006f9f45f/0xad5b343a26573fb9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.208166:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.208169:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.208171:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.208713:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.208733:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.210517:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.210530:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.210548:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.210553:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.210559:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.210573:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.210582:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.210589:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.210612:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839849.211293:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.211301:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.211310:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.211321:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.211330:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.211347:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.211354:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ebb84c2/0xad5b343a26573fc0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.211376:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.211377:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.211379:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.218219:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.218246:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.218263:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.218272:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.218279:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.218293:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.218304:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.218320:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.218342:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788839849.220202:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.220213:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220243:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.220249:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.220255:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220268:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220278:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220285:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220305:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839849.220316:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839849.220323:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220342:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.220346:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220355:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220372:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220379:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051b00a4d/0xad5b343a26573fc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220398:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.220401:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220406:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfc200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.220409:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220415:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220424:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220436:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ae3a5e/0xad5b343a26573fce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.220447:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.220449:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.220451:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.221070:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.221500:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.221507:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.221529:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.221532:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.221537:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.221547:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.221556:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.221562:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.221578:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839849.224084:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.224096:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.224110:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.224114:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.224119:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.224132:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.224158:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.224165:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.224185:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788839849.224621:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788839849.224628:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224636:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.224641:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224649:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224664:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224671:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd35d611/0xad5b343a26573fd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224703:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.224707:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224724:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.224728:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224736:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224746:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224753:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb9a677e/0xad5b343a26573fdc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.224789:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.224791:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.224793:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.224798:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.228763:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.228794:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228812:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.228816:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.228823:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228849:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228859:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228867:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228885:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839849.228895:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.228901:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228909:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.228913:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228922:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228936:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228943:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007903cb5/0xad5b343a26573fe3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.228965:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.228967:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.228969:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.232190:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.232202:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.232219:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.232448:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.232456:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.232470:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.232480:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.232487:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.232509:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.232920:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.232928:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.232937:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.232942:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.232951:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.232968:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.232976:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a26573fea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.232994:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.233003:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.233005:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.233603:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.233610:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.233630:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.233634:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.233639:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.233650:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.233657:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.233685:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.233702:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.234168:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.234175:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.234183:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.234194:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.234203:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.234215:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.234222:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8bcc0c/0xad5b343a26573ff1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.234401:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.234403:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.234405:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788839849.242688:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839849.242703:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.242729:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788839849.242734:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839849.242743:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.242791:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.242804:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.242812:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.242830:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839849.243117:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.243125:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.243133:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.243137:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.243146:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.243195:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.243204:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f870de7/0xad5b343a26573ff8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.243234:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.243243:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.243245:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.245905:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.245919:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.245936:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.245941:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.245953:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.245969:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.245979:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.245988:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246009:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839849.246736:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.246744:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246753:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.246756:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.246760:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246788:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246797:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246816:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246834:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839849.246847:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839849.246853:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246861:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647842200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.246866:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246875:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246891:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246899:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90aff98/0xad5b343a26573fff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246916:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.246919:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246935:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.246939:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246946:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246957:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246964:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9c95a45/0xad5b343a26574006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.246979:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.246981:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.246982:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.247598:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.249840:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.249850:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.249865:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.249869:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.249875:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.249889:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.249904:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.249912:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.249929:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839849.250134:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.250141:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.250150:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.250154:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.250173:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.250491:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.250501:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbfc7bb/0xad5b343a2657400d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.250529:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.250530:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.250532:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.251571:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.251579:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.251591:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.251595:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.251600:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.251611:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.251620:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.251628:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.251665:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839849.253806:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.253817:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253833:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.253837:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.253842:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253855:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253864:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253872:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253890:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839849.253900:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839849.253907:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253915:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.253931:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253939:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253953:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253961:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a26574014 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253976:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.253980:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253986:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.253989:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.253996:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.254006:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.254013:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a2657401b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.254032:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.254034:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.254036:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.254050:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788839849.254090:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839849.254096:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254104:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788839849.254106:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839849.254110:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254120:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254133:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254140:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254154:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.254162:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.254166:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254174:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.254176:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254183:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254194:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254201:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a26574022 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.254214:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.254221:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.254223:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788839849.256270:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839849.256282:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.256296:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788839849.256301:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839849.256306:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.256319:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.256328:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.256336:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.256353:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.256803:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.256809:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.256818:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.256823:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.256832:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.256850:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.256858:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e3ab414/0xad5b343a26574029 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.256875:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.256877:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.256879:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839849.259519:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.259532:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.259549:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.259554:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.259559:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.259574:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.259583:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.259591:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.259607:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.260582:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.260592:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.260601:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.260606:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.260628:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.260647:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.260655:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4fec0a9/0xad5b343a26574030 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.260673:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.260685:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.260687:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788839849.276766:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788839849.276822:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788839849.276827:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788839849.278122:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.278136:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.278153:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.278347:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.278358:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.278376:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.279360:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.279369:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.279403:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.280413:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.280423:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280434:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.280440:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280450:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280469:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280499:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000296f5eff/0xad5b343a26574037 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280521:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.280523:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.280524:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788839849.280764:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839849.280792:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280803:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788839849.280808:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839849.280813:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280823:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280831:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280838:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.280863:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788839849.281238:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:17858:x1875734060794112:12345-0@lo:5:osp-pre-1-1.0 Request processed in 95136us (95469us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788839849.281254:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788839849.281840:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.281849:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.281859:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.281864:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.281884:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.281896:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.281902:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008be9d29f/0xad5b343a2657403e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.281920:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.281921:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.281922:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839849.282906:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.282915:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.282928:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.282933:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.282938:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.282950:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.282959:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.282966:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.282987:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788839849.284289:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.284298:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.284310:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.284314:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.284326:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.284337:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.284345:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.284367:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.284380:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839849.284705:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839849.284713:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284722:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.284727:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284736:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284754:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284805:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048eaad3f/0xad5b343a26574045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284824:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.284827:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284835:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.284838:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284845:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284855:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284863:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6693a81/0xad5b343a2657404c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.284874:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.284875:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.284877:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839849.285421:0:17858:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788839849.285439:0:17858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17858:1875734060794112:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788839849.285455:0:17858:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788839849.285504:0:17858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17858:1875734060794240:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788839849.285571:0:17858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839849.285601:0:17858:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788839849.285614:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839849.285638:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794240 00000100:00100000:3.0:1788839849.285643:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794240 00000100:00100000:3.0:1788839849.285692:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788839849.285700:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17858:x1875734060794240:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788839849.285754:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17858:x1875734060794240:12345-0@lo:900:osp-pre-1-1.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839849.285762:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788839849.285903:0:17858:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7819fb800 x1875734060794240/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788839865 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788839849.285914:0:17858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17858:1875734060794240:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1788839849.286398:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.286406:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286424:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.286428:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.286433:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286444:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286452:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286460:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286476:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.286486:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.286491:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286498:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.286501:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286509:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286530:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286537:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574053 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.286551:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.286553:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.286555:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.287519:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.287528:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287540:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.287543:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.287548:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287567:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287577:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287584:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287600:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839849.287609:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.287613:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287633:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.287636:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287644:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287656:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287663:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063cbe956/0xad5b343a2657405a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.287690:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.287693:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.287694:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.290671:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.290691:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.290707:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.290711:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.290716:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.290729:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.290749:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.290757:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.290794:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788839849.293929:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.293944:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.293964:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.293968:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.293974:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.293990:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.293999:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.294017:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.294033:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788839849.294347:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839849.294355:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294363:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.294367:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294376:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294400:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294408:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001aebc745/0xad5b343a26574061 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294427:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.294431:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294437:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.294440:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294447:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294456:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294463:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132f0bca/0xad5b343a26574068 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.294476:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.294477:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.294484:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.294889:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.294981:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.294989:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295001:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.295006:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.295011:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295022:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295030:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295038:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295066:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839849.295951:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.295959:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295969:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.295972:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.295976:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295985:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295992:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.295999:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.296008:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788839849.296426:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839849.296433:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296442:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.296447:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296455:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296469:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296476:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ffef6d2/0xad5b343a2657406f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296492:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.296495:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296502:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.296504:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296512:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296530:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296537:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf09d0fc/0xad5b343a26574076 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.296552:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.296553:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.296555:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.296735:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839849.297646:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.297656:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.297688:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.297691:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.297696:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.297707:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.297716:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.297723:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.297742:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.298369:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.298377:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.298385:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.298396:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.298405:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.298420:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.298427:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c135b6d0/0xad5b343a2657407d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.298445:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.298446:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.298448:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839849.299693:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.299704:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.299724:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.299728:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.299733:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.299744:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.299753:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.299760:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.299789:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.299853:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.299860:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.299868:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.299872:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.299880:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.299892:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.299899:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ca4095c/0xad5b343a26574084 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.299925:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.299927:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.299928:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.300327:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.300334:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.300344:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.300347:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.300362:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.300372:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.300380:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.300393:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.300415:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.300566:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.300572:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.300580:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.300584:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.300593:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.300604:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.300612:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c84a8f86/0xad5b343a2657408b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.300628:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.300630:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.300631:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.301226:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.301233:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.301244:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.301247:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.301252:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.301261:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.301270:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.301277:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.301301:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.301439:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.301445:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.301464:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.301468:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.301477:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.301500:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.301508:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be078e4f/0xad5b343a26574092 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.301522:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.301524:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.301526:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839849.302051:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.302059:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.302069:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.302072:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.302077:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.302087:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.302105:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.302113:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.302134:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.302359:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.302365:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.302373:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.302377:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.302384:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.302402:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.302409:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec889654/0xad5b343a26574099 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.302423:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.302425:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.302427:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.303090:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.303098:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.303113:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.303117:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.303122:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.303133:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.303141:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.303149:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.303171:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.306067:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.306083:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.306097:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.306102:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.306113:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.306133:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.306141:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051be4c0c/0xad5b343a265740a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.306189:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.306191:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.306192:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788839849.307010:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788839849.307020:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.307033:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=504s v=(0 0) 00010000:00010000:1.0:1788839849.307038:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788839849.307044:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.307056:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.307064:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.307071:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.307102:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788839849.307543:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.307551:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307560:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.307586:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.307591:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307602:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307621:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307628:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307643:0:19203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788839849.307652:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788839849.307662:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307670:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.307682:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307690:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307702:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307710:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f12f4a4a/0xad5b343a265740a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307726:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.307735:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307742:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.307745:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307753:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307762:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307800:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c46f6769/0xad5b343a265740ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.307814:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.307815:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.307817:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.307996:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788839849.308922:0:19203:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788839849.309020:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17138:x1875734060793856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 126500us (152997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839849.309031:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788839849.309710:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a49880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17138:1875734060793856:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788839849.309728:0:17138:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788839849.309801:0:17138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17138:1875734060794368:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788839849.309840:0:17138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839849.309876:0:17138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646938e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788839849.314922:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794368 00000100:00100000:2.0:1788839849.314936:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794368 00000100:00100000:2.0:1788839849.314998:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839849.315008:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17138:x1875734060794368:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788839849.315063:0:18620:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:3.0:1788839849.315955:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839849.315966:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.315984:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788839849.315988:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839849.315995:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.316009:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.316019:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.316028:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.316058:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.316941:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.316950:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.316960:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782079000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.316965:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.316976:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.316994:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.317001:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000615b4805/0xad5b343a265740b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.317020:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.317022:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.317023:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.320721:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.320733:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.320750:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.320755:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.320761:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.320813:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.320826:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.320834:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.320853:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.321032:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.321039:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.321048:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.321053:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.321062:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.321078:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.321086:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa4ba9ba/0xad5b343a265740bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.321103:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.321105:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.321106:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.322715:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.322726:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.322740:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.322744:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.322749:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.322760:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.322792:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.322814:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.322830:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.323058:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.323065:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.323073:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6a00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.323083:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.323091:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.323103:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.323110:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a660ac8/0xad5b343a265740c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.323127:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.323129:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.323131:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.326462:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.326482:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326499:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.326503:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.326509:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326523:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326532:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326540:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326572:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.326583:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.326588:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326604:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.326608:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326616:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326632:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326639:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.326659:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.326661:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.326663:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.327949:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.327959:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.327984:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.327987:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.327993:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.330481:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.330506:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.330514:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.332449:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788839849.333422:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788839849.333432:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333448:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788839849.333453:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788839849.333459:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333473:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.333482:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.333494:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.333498:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333503:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.333506:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839849.333510:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333517:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839849.333519:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333524:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.333527:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333533:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839849.333535:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333537:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.333543:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbe6a85c/0xad5b343a265740d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333545:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.333554:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.333561:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839849.333563:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839849.333564:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.334863:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea03fc2f/0xad5b343a265740d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.334883:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.334890:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.334893:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788839849.337177:0:18617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788839849.337222:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788839849.337629:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.337639:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.337655:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.337660:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.337666:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.337690:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.337699:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.337706:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.337750:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.338182:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.338189:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.338198:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.338202:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.338211:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.338245:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.338253:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c46f6769/0xad5b343a265740df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.338272:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.338274:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.338276:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.338468:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.338474:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.338484:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.338488:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.338492:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.338502:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.338510:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.338517:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.338539:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788839849.338929:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17138:x1875734060794368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23919us (29083us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788839849.338939:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839849.339251:0:17138:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788839849.339260:0:17138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17138:1875734060794368:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788839849.339277:0:17138:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788839849.339452:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.339458:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.339467:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.339470:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.339489:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.339503:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.339511:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faaf0f04/0xad5b343a265740e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.339529:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.339530:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.339532:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.340584:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.340593:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.340606:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.340610:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.340615:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.340625:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.340634:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.340668:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.340705:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788839849.340807:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788839849.340814:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.340821:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:1.0:1788839849.340831:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.340840:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.340991:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.341000:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063cbe956/0xad5b343a265740ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839849.341019:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839849.341020:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788839849.341022:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.342361:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.342371:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.342385:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.342389:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.342394:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.342405:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.342413:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.342420:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.342437:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.345353:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.345367:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.345382:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68c00 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.345386:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.345396:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.345415:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.345437:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6c3a300/0xad5b343a265740f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.345463:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.345464:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.345466:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.345946:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.345954:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.345974:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.345979:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.345986:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.345999:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.346009:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.346016:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.346043:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788839849.346456:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839849.346463:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.346477:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839849.346480:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.346488:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.346500:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.346507:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f126670a/0xad5b343a265740fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.346523:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.346524:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839849.346526:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.348889:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.348904:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.348925:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.348929:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.348936:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.348951:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.348973:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.348981:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.349005:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.349279:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.349287:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.349296:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6800 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.349301:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.349320:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.349336:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.349343:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069c38c8d/0xad5b343a26574102 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.349361:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.349363:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.349364:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.349711:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.349718:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.349729:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.349731:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.349736:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.349745:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.349752:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.349759:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.349812:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.350015:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.350022:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.350031:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.350035:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.350044:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.350058:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.350066:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5403f3b/0xad5b343a26574109 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.350081:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.350083:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.350084:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788839849.357570:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788839849.357586:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.357605:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=504s v=(0 0) 00010000:00010000:2.0:1788839849.357611:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839849.357617:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.357632:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.357644:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.357652:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.357684:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788839849.357926:0:17102:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.357934:0:17102:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.357942:0:17102:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.357946:0:17102:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.357967:0:17102:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.357983:0:17102:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.357990:0:17102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012127099/0xad5b343a26574110 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.358006:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.358007:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.358009:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.369904:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.369917:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.369934:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.369939:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.369945:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.369959:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.369977:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.369985:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.370004:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788839849.370281:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788839849.370288:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.370297:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68000 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839849.370307:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.370317:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.370336:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.370344:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c896f96/0xad5b343a26574117 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839849.370363:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.370364:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839849.370366:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788839849.371009:0:18622:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788839849.371017:0:18622:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.371028:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=504s v=(0 0) 00010000:00010000:0.0:1788839849.371032:0:18622:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839849.371037:0:18622:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.371048:0:18622:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.371056:0:18622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.371065:0:18622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839849.371090:0:18622:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788839849.371134:0:18622:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:0.0:1788839849.371246:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17140:x1875734060793600:12345-0@lo:5:osp-pre-1-0.0 Request processed in 207004us (215411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839849.371256:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839849.371354:0:17140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17140:1875734060793600:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788839849.371370:0:17140:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:1.0:1788839849.371417:0:17140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17140:1875734060794496:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788839849.371452:0:17140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839849.371481:0:17140:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab745d94180 going to sleep for 11 seconds 00010000:00010000:3.0:1788839849.371658:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839849.371665:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.371673:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69400 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:3.0:1788839849.371685:0:17101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.371695:0:17101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.371708:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.371727:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000e05cde/0xad5b343a2657411e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18622 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839849.371743:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.371745:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839849.371746:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839849.371926:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794496 00000100:00100000:0.0:1788839849.371932:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794496 00000100:00100000:0.0:1788839849.371976:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788839849.371985:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17140:x1875734060794496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788839849.372026:0:18621:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788839849.388930:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17140:x1875734060794496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16939us (17470us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788839849.388943:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839849.389569:0:17140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647bb7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17140:1875734060794496:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788839849.389586:0:17140:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000040:00080000:1.0:1788839849.409477:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788839849.409842:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839850.455845:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839851.454992:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839852.418943:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839852.418966:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060794624:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839852.419086:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839852.419227:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794624 00000100:00100000:0.0:1788839852.419236:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794624 00000100:00100000:0.0:1788839852.419300:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839852.419311:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060794624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839852.419339:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788839852.419386:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060794624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839852.419393:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839852.419442:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060794624:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788839852.420297:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788839852.482732:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839853.438932:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060794752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788839853.439002:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839853.440141:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788839853.440178:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060794880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839853.440221:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839853.440271:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794752 00000100:00100000:0.0:1788839853.440279:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794752 00000100:00100000:0.0:1788839853.440320:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060794880 00000100:00100000:0.0:1788839853.440323:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060794880 00000100:00100000:0.0:1788839853.440339:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788839853.440348:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060794752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839853.440379:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839853.446545:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839853.446565:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060794880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839853.446604:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788839853.446709:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060794880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 152us (6486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839853.446723:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788839853.446818:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060794880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839853.455582:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060794752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 15225us (16570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839853.455598:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788839853.456444:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060794752:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788839853.508431:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788839853.906627:0:19793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788839854.463553:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788839854.463574:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060795136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839854.463783:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.466389:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795136 00000100:00100000:0.0:1788839854.466401:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795136 00000100:00100000:0.0:1788839854.466465:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788839854.466475:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060795136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788839854.466507:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788839854.466581:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060795136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (2821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839854.466588:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788839854.466618:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788839854.466673:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060795136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839854.467699:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060795008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839854.467750:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.467951:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795008 00000100:00100000:0.0:1788839854.467957:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795008 00000100:00100000:0.0:1788839854.467990:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788839854.467998:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060795008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788839854.468018:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788839854.468084:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875734060795008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839854.468091:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788839854.468106:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839854.468130:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab647af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060795008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788839854.474013:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788839854.474035:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060795264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839854.474095:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.474146:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795264 00000100:00100000:0.0:1788839854.474153:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795264 00000100:00100000:0.0:1788839854.474200:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788839854.474207:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060795264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788839854.474228:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788839854.474267:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060795264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839854.474273:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788839854.474290:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839854.474322:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060795264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839854.474975:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060795776:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.475008:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839854.475029:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060796288:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.475049:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839854.475066:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788839854.475071:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060795648:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.475089:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839854.475115:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060796160:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.475133:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.475207:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060795392:0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.475235:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.475258:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060795904:0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.475277:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.475290:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060796416:0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.475315:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060795520:0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.475334:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839854.475356:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060796032:0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.475382:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795392 00000100:00100000:0.0:1788839854.475386:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795392 00000100:00100000:0.0:1788839854.475413:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788839854.475420:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060795392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.476267:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060795392:12345-0@lo:400:kworker.0 Request processed in 844us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839854.476276:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788839854.476312:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795904 00000100:00100000:0.0:1788839854.476317:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795904 00000100:00100000:0.0:1788839854.476348:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839854.476354:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060795904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.476384:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060795904:12345-0@lo:400:kworker.0 Request processed in 29us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839854.476390:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788839854.476405:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795776 00000100:00100000:0.0:1788839854.476408:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795776 00000100:00100000:0.0:1788839854.477551:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795520 00000100:00100000:0.0:1788839854.477559:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795520 00000100:00100000:0.0:1788839854.477585:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788839854.477592:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060795776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.487939:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788839854.487956:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060795520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.488026:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060795520:12345-0@lo:400:kworker.0 Request processed in 78us (12690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.488032:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788839854.488060:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796288 00000100:00100000:2.0:1788839854.488068:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796288 00000100:00100000:2.0:1788839854.488110:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060795648 00000100:00100000:2.0:1788839854.488114:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060795648 00000100:00100000:2.0:1788839854.488126:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796160 00000100:00100000:2.0:1788839854.488129:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796160 00000100:00100000:2.0:1788839854.488150:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839854.488156:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060796288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.488192:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875734060796288:12345-0@lo:400:kworker.0 Request processed in 35us (13141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.488201:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788839854.488213:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839854.488219:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060795648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.488262:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060795648:12345-0@lo:400:kworker.0 Request processed in 43us (13171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.488268:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788839854.488280:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788839854.488285:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060796160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.488310:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875734060796160:12345-0@lo:400:kworker.0 Request processed in 25us (13176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.488321:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788839854.488377:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777d49500 x1875734060795648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839854.488391:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060795648:0@lo:400:kworker.0 00010000:00080000:2.0:1788839854.488402:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478af800 x1875734060796160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839854.488410:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875734060796160:0@lo:400:kworker.0 00010000:00080000:2.0:1788839854.488420:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478aea00 x1875734060796288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839854.488428:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875734060796288:0@lo:400:kworker.0 00000100:00080000:2.0:1788839854.489735:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839854.489743:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839854.489746:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788839854.489783:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839854.489836:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060795392:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.489852:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060795904:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.489884:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796416 00000100:00100000:2.0:1788839854.489888:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796416 00000100:00100000:2.0:1788839854.489925:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788839854.489932:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060796416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.489984:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875734060796416:12345-0@lo:400:kworker.0 Request processed in 52us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.489991:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788839854.490014:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788839854.490034:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ace00 x1875734060796416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839854.490045:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875734060796416:0@lo:400:kworker.0 00000100:00100000:1.0:1788839854.495845:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839854.495882:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060796544:0@lo:400:kworker.0 00000100:00100000:1.0:1788839854.495938:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839854.495980:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060795520:0@lo:400:kworker.0 00000100:00100000:0.0:1788839854.496084:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060795776:12345-0@lo:400:kworker.0 Request processed in 18041us (20624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839854.496095:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788839854.496207:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060795776:0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.496230:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796032 00000100:00100000:2.0:1788839854.496236:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796032 00000100:00100000:2.0:1788839854.496277:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796544 00000100:00100000:2.0:1788839854.496280:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796544 00000100:00100000:2.0:1788839854.496310:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839854.496318:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060796032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.496366:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875734060796032:12345-0@lo:400:kworker.0 Request processed in 49us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.496372:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788839854.496385:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788839854.496391:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060796544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839854.496417:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875734060796544:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839854.496421:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788839854.496527:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ad180 x1875734060796032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839854.496538:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875734060796032:0@lo:400:kworker.0 00010000:00080000:1.0:1788839854.496548:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab6478ae300 x1875734060796544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839854.496556:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875734060796544:0@lo:400:kworker.0 00000100:00080000:2.0:1788839854.496593:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788839854.532225:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788839854.829076:0:19845:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839854.829369:0:19845:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1788839854.978235:0:19436:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:1.0:1788839855.561367:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788839855.935734:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1788839855.976691:0:19895:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788839855.978010:0:19895:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788839856.235876:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.236558:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050228736 00000100:00100000:3.0:1788839856.236568:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050228736 00000100:00100000:3.0:1788839856.236615:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1788839856.236623:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2388:x1875734050228736:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788839856.236661:0:17108:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from ccda0330-6550-4161-8186-8c642452683e@192.168.203.52@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:3.0:1788839856.236690:0:17108:0:(genops.c:1385:class_connect()) connect: client ccda0330-6550-4161-8186-8c642452683e, cookie 0xad5b343a26574125 00000100:00080000:3.0:1788839856.236862:0:17108:0:(import.c:65:import_set_state_nolock()) ffff8ab647a03000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839856.236926:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+5:2388:x1875734050228736:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 302us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.236934:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1788839856.244186:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.244648:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050228864 00000100:00100000:3.0:1788839856.244658:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050228864 00000100:00100000:3.0:1788839856.244718:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1788839856.244729:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+5:14907:x1875734050228864:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788839856.244745:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839856.244787:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078a00/0xad5b343a2657412c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bf1 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.244816:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078a00/0xad5b343a2657412c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bf1 expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.244827:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078a00/0xad5b343a2657412c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bf1 expref: 6 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.244837:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078a00, rc 0) 00000100:00100000:3.0:1788839856.244891:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+6:14907:x1875734050228864:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 164us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.244898:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1788839856.250530:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839856.250587:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050228992 00000100:00100000:0.0:1788839856.250600:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050228992 00000100:00100000:0.0:1788839856.250661:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1788839856.250670:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+6:14907:x1875734050228992:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788839856.250800:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+6:14907:x1875734050228992:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 130us (276us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788839856.250809:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1788839856.253799:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.253868:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229120 00000100:00100000:3.0:1788839856.253876:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229120 00000100:00100000:3.0:1788839856.253926:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1788839856.253936:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+6:14907:x1875734050229120:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788839856.253959:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839856.253977:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078200/0xad5b343a26574133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74bf8 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.254003:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078200/0xad5b343a26574133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bf8 expref: 7 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.254014:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078200/0xad5b343a26574133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74bf8 expref: 7 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.254024:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078200, rc 0) 00000100:00100000:3.0:1788839856.254070:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+7:14907:x1875734050229120:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 136us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.254077:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:1.0:1788839856.258939:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.259048:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229248 00000100:00100000:3.0:1788839856.259057:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229248 00000100:00100000:3.0:1788839856.259105:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1788839856.259114:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+7:14907:x1875734050229248:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788839856.259801:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+8:14907:x1875734050229248:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 654us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.259811:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:1.0:1788839856.263447:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839856.263517:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229376 00000100:00100000:0.0:1788839856.263526:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229376 00000100:00100000:0.0:1788839856.263575:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1788839856.263584:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+8:14907:x1875734050229376:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788839856.263934:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+8:14907:x1875734050229376:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 350us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839856.263942:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1788839856.266937:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.268024:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229504 00000100:00100000:2.0:1788839856.268037:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229504 00000100:00100000:3.0:1788839856.268132:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788839856.268143:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+8:14926:x1875734050229504:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839856.268289:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+8:14926:x1875734050229504:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 148us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.268308:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1788839856.291601:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.291685:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229632 00000100:00100000:2.0:1788839856.291694:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229632 00000100:00100000:2.0:1788839856.291756:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788839856.291766:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+8:14926:x1875734050229632:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839856.291977:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+8:14926:x1875734050229632:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 211us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.291991:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1788839856.302416:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.302546:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229760 00000100:00100000:3.0:1788839856.302555:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229760 00000100:00100000:3.0:1788839856.302613:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:3.0:1788839856.302626:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+8:14926:x1875734050229760:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788839856.302810:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+8:14926:x1875734050229760:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 184us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.302817:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:3.0:1788839856.310562:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.310597:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050229888 00000100:00100000:3.0:1788839856.310606:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050229888 00000100:00100000:3.0:1788839856.312126:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:3.0:1788839856.312143:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+8:14907:x1875734050229888:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788839856.312163:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839856.312183:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782078000/0xad5b343a2657413a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74c29 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.312213:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782078000/0xad5b343a2657413a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c29 expref: 9 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.312224:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782078000/0xad5b343a2657413a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c29 expref: 9 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839856.312235:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078000, rc 0) 00000100:00100000:3.0:1788839856.312298:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+9:14907:x1875734050229888:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 160us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.312317:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:0.0:1788839856.318445:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.318689:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230016 00000100:00100000:3.0:1788839856.318698:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230016 00000100:00100000:3.0:1788839856.318752:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1788839856.318763:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+9:14907:x1875734050230016:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788839856.325450:0:17108:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788839856.325481:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788839856.325486:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788839856.325489:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788839856.325493:0:17108:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788839856.325496:0:17108:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788839856.327196:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+9:14907:x1875734050230016:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 8427us (8753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.327210:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1788839856.337110:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839856.338591:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230144 00000100:00100000:0.0:1788839856.338604:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230144 00000100:00100000:0.0:1788839856.339464:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1788839856.339477:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+9:14907:x1875734050230144:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839856.339495:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839856.339513:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74c30 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839856.339541:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 10 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839856.339554:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 10 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839856.339574:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68e00, rc 0) 00000100:00100000:0.0:1788839856.339649:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+10:14907:x1875734050230144:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 175us (2545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839856.339657:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1788839856.347645:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839856.369876:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230272 00000100:00100000:1.0:1788839856.369890:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230272 00000100:00100000:1.0:1788839856.369966:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1788839856.369975:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+10:14907:x1875734050230272:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788839856.370135:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+10:14907:x1875734050230272:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 161us (22505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839856.370143:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1788839856.375950:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.376038:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230400 00000100:00100000:3.0:1788839856.376047:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230400 00000100:00100000:3.0:1788839856.376088:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1788839856.376097:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab74f977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+10:14907:x1875734050230400:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788839856.376234:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab74f977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+10:14907:x1875734050230400:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 138us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.376241:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1788839856.386752:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839856.386922:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230528 00000100:00100000:1.0:1788839856.386931:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230528 00000100:00100000:1.0:1788839856.386989:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:1.0:1788839856.386999:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+10:14931:x1875734050230528:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839856.387138:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+10:14931:x1875734050230528:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 141us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839856.387146:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:1.0:1788839856.395278:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.395351:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230656 00000100:00100000:2.0:1788839856.395361:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230656 00000100:00100000:2.0:1788839856.395414:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1788839856.395425:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+10:14931:x1875734050230656:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839856.395575:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780013850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+10:14931:x1875734050230656:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 152us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.395583:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1788839856.399847:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839856.399928:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230784 00000100:00100000:0.0:1788839856.399938:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230784 00000100:00100000:0.0:1788839856.399987:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788839856.399995:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2388:x1875734050230784:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788839856.400024:0:17114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fb9a0095-2d97-404b-912c-8b552d60d900@192.168.203.52@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:0.0:1788839856.400070:0:17114:0:(genops.c:1385:class_connect()) connect: client fb9a0095-2d97-404b-912c-8b552d60d900, cookie 0xad5b343a26574148 00000004:00100000:0.0:1788839856.400095:0:17114:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788839856.400291:0:17114:0:(import.c:65:import_set_state_nolock()) ffff8ab746a1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788839856.400364:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:2388:x1875734050230784:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 367us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839856.400371:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1788839856.411258:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.411337:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231040 00000100:00100000:2.0:1788839856.411348:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231040 00000100:00100000:2.0:1788839856.411399:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788839856.411408:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1875734050231040:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788839856.411445:0:17115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from fb9a0095-2d97-404b-912c-8b552d60d900@192.168.203.52@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1788839856.411490:0:17115:0:(genops.c:1385:class_connect()) connect: client fb9a0095-2d97-404b-912c-8b552d60d900, cookie 0xad5b343a2657414f 00000004:00100000:2.0:1788839856.411515:0:17115:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00100000:3.0:1788839856.411724:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.411807:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00080000:2.0:1788839856.411840:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8ab64751e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788839856.411907:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:2388:x1875734050231040:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 498us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.411915:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788839856.411929:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050230912 00000100:00100000:2.0:1788839856.411932:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050230912 00000100:00100000:2.0:1788839856.411959:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231296 00000100:00100000:2.0:1788839856.411962:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231296 00000100:00100000:2.0:1788839856.411975:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839856.411981:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+7:0:x1875734050230912:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788839856.412003:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788839856.412046:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+7:0:x1875734050230912:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 65us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.412052:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839856.412064:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788839856.412070:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231296:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788839856.412080:0:17115:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788839856.412101:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231296:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 32us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.412106:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:2.0:1788839856.412123:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839856.419226:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.419399:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231424 00000100:00100000:2.0:1788839856.419408:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231424 00000100:00100000:2.0:1788839856.419815:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788839856.419827:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231424:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788839856.419925:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231424:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 101us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.419945:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1788839856.420794:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.430212:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.430249:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231808 00000100:00100000:3.0:1788839856.430272:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231808 00000100:00100000:3.0:1788839856.430371:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788839856.430382:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231808:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788839856.430469:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231808:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839856.430477:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788839856.430521:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839856.430594:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839856.430687:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231552 00000100:00100000:1.0:1788839856.430692:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231552 00000100:00100000:1.0:1788839856.430722:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231680 00000100:00100000:1.0:1788839856.430725:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231680 00000100:00100000:1.0:1788839856.430743:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788839856.430748:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1875734050231552:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788839856.430792:0:19203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fb9a0095-2d97-404b-912c-8b552d60d900@192.168.203.52@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:1.0:1788839856.430821:0:19203:0:(genops.c:1385:class_connect()) connect: client fb9a0095-2d97-404b-912c-8b552d60d900, cookie 0xad5b343a26574156 00002000:00100000:1.0:1788839856.430833:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb9a0095-2d97-404b-912c-8b552d60d900/ffff8ab6479d7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788839856.430850:0:19203:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788839856.431000:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788839856.431029:0:19203:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839856.431061:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+6:2388:x1875734050231552:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 312us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839856.431067:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1788839856.431079:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1788839856.431083:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2388:x1875734050231680:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788839856.431097:0:19203:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fb9a0095-2d97-404b-912c-8b552d60d900@192.168.203.52@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:1.0:1788839856.431111:0:19203:0:(genops.c:1385:class_connect()) connect: client fb9a0095-2d97-404b-912c-8b552d60d900, cookie 0xad5b343a2657415d 00002000:00100000:1.0:1788839856.431115:0:19203:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fb9a0095-2d97-404b-912c-8b552d60d900/ffff8ab6479d0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788839856.431125:0:19203:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788839856.431233:0:19203:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788839856.431246:0:19203:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839856.431279:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+6:2388:x1875734050231680:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 194us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839856.431285:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788839856.440048:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231168 00000100:00100000:0.0:1788839856.440065:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231168 00000100:00100000:0.0:1788839856.440992:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788839856.441004:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:0:x1875734050231168:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788839856.441040:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788839856.441121:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:0:x1875734050231168:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 119us (20349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839856.441129:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:3.0:1788839856.448961:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839856.449455:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.449548:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050231936 00000100:00100000:2.0:1788839856.449557:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050231936 00000100:00100000:2.0:1788839856.449603:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788839856.449621:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231936:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788839856.454342:0:17116:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4623us 00000004:00200000:2.0:1788839856.469919:0:17116:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788839856.470032:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+6:14907:x1875734050231936:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 20415us (20578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.470042:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:2.0:1788839856.576595:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839856.719073:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839856.719199:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232064 00000100:00100000:2.0:1788839856.719207:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232064 00000100:00100000:2.0:1788839856.719270:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788839856.719281:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:14954:x1875734050232064:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:2.0:1788839856.719303:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839856.719329:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574164 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74c61 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839856.719393:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657416b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839856.719407:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657416b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839856.719420:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657416b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839856.719478:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839856.719482:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839856.719532:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657416b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839856.719558:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574164 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c61 expref: 8 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839856.719575:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657416b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c61 expref: 7 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839856.719584:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839856.719588:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839856.719593:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6400, rc 0) 00000100:00100000:2.0:1788839856.719676:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+7:14954:x1875734050232064:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 396us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839856.719683:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788839857.535327:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060796672:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839857.535401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839857.535508:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796672 00000100:00100000:0.0:1788839857.535516:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796672 00000100:00100000:0.0:1788839857.535584:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839857.535595:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060796672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788839857.535635:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788839857.535693:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060796672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839857.535700:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839857.535729:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060796672:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788839857.535977:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788839857.601136:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839858.559236:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839858.559258:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060796800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839858.559374:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839858.559578:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796800 00000100:00100000:1.0:1788839858.559586:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796800 00000100:00100000:1.0:1788839858.559649:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788839858.559658:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060796800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788839858.559691:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788839858.559746:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060796800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839858.559753:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788839858.559926:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060796800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788839858.560043:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839858.560054:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060796928:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839858.560103:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839858.560243:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060796928 00000100:00100000:0.0:1788839858.560248:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060796928 00000100:00100000:0.0:1788839858.560287:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788839858.560296:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060796928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839858.560315:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788839858.560362:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060796928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839858.560368:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788839858.560765:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060796928:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788839858.623092:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839858.850113:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839858.850375:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232192 00000100:00100000:1.0:1788839858.850386:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232192 00000100:00100000:1.0:1788839858.850468:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:2.0:1788839858.850572:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839858.850721:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+7:15006:x1875734050232192:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:1.0:1788839858.850756:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839858.850880:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+7:15006:x1875734050232192:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 403us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839858.850955:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1788839858.884304:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839858.885067:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232320 00000100:00100000:2.0:1788839858.885089:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232320 00000100:00100000:2.0:1788839858.885166:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788839858.885176:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:15006:x1875734050232320:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:2.0:1788839858.885204:0:17114:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788839858.885299:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:15006:x1875734050232320:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 125us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839858.885307:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:3.0:1788839858.890180:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839858.891112:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839858.892815:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232448 00000100:00100000:2.0:1788839858.892828:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232448 00000100:00100000:2.0:1788839858.892918:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788839858.892928:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb9a0095-2d97-404b-912c-8b552d60d900+6:15006:x1875734050232448:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1788839858.892982:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788839858.893072:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb9a0095-2d97-404b-912c-8b552d60d900+6:15006:x1875734050232448:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 145us (1966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839858.893079:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:3.0:1788839858.897699:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839858.899926:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839858.902363:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232576 00000100:00100000:2.0:1788839858.902377:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232576 00000100:00100000:2.0:1788839858.902463:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788839858.902473:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb9a0095-2d97-404b-912c-8b552d60d900+6:15006:x1875734050232576:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1788839858.902504:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788839858.902600:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb9a0095-2d97-404b-912c-8b552d60d900+6:15006:x1875734050232576:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 121us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839858.902607:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00080000:3.0:1788839858.904654:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839859.123735:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.123811:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232704 00000100:00100000:3.0:1788839859.123821:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232704 00000100:00100000:3.0:1788839859.123948:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1788839859.123960:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+10:15037:x1875734050232704:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788839859.123978:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839859.123997:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782079200/0xad5b343a26574172 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74c68 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.124026:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782079200/0xad5b343a26574172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c68 expref: 11 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.124038:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782079200/0xad5b343a26574172 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c68 expref: 11 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.124047:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079200, rc 0) 00000100:00100000:3.0:1788839859.124110:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780010850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+11:15037:x1875734050232704:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 153us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.124129:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:0.0:1788839859.138463:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.138715:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232832 00000100:00100000:1.0:1788839859.138725:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232832 00000100:00100000:1.0:1788839859.138816:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:1.0:1788839859.138828:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+11:15037:x1875734050232832:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788839859.139235:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+11:15037:x1875734050232832:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 407us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.139244:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:1.0:1788839859.151396:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.151477:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050232960 00000100:00100000:3.0:1788839859.151487:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050232960 00000100:00100000:3.0:1788839859.151590:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1788839859.151602:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+11:15037:x1875734050232960:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788839859.151744:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780011450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+11:15037:x1875734050232960:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.151751:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:0.0:1788839859.170484:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.170967:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233088 00000100:00100000:1.0:1788839859.170979:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233088 00000100:00100000:1.0:1788839859.171042:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:1.0:1788839859.171053:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+11:15045:x1875734050233088:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839859.171219:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+11:15045:x1875734050233088:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 168us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.171238:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:0.0:1788839859.226991:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.227240:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233216 00000100:00100000:1.0:1788839859.227251:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233216 00000100:00100000:1.0:1788839859.227315:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1788839859.227326:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+11:15045:x1875734050233216:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839859.227489:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+11:15045:x1875734050233216:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 164us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.227497:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1788839859.249217:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839859.252978:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233344 00000100:00100000:2.0:1788839859.252992:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233344 00000100:00100000:2.0:1788839859.253061:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:2.0:1788839859.253089:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+11:15045:x1875734050233344:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788839859.253225:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+11:15045:x1875734050233344:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 144us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839859.253232:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:2.0:1788839859.257987:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839859.258071:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233472 00000100:00100000:0.0:1788839859.258080:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233472 00000100:00100000:0.0:1788839859.258196:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:0.0:1788839859.258205:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+11:15037:x1875734050233472:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788839859.258233:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839859.258249:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab781e69000/0xad5b343a26574179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74c99 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839859.258278:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e69000/0xad5b343a26574179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c99 expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839859.258290:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab781e69000/0xad5b343a26574179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c99 expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839859.258299:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e69000, rc 0) 00000100:00100000:0.0:1788839859.258533:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+12:15037:x1875734050233472:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 327us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.258541:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:0.0:1788839859.265262:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.265319:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233600 00000100:00100000:1.0:1788839859.265329:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233600 00000100:00100000:1.0:1788839859.265398:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:1.0:1788839859.265410:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+12:15037:x1875734050233600:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788839859.265433:0:17105:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788839859.265456:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788839859.265460:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788839859.265462:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788839859.265465:0:17105:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788839859.265467:0:17105:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788839859.278102:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+12:15037:x1875734050233600:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 12683us (12833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.278119:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:0.0:1788839859.283588:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.283972:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233728 00000100:00100000:1.0:1788839859.283982:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233728 00000100:00100000:1.0:1788839859.284041:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:1.0:1788839859.284051:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+12:15037:x1875734050233728:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788839859.284070:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839859.284088:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ca0 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839859.284136:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839859.284148:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839859.284157:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958000, rc 0) 00000100:00100000:1.0:1788839859.284211:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:15037:x1875734050233728:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 162us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.284217:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:0.0:1788839859.286089:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.286171:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233856 00000100:00100000:3.0:1788839859.286180:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233856 00000100:00100000:3.0:1788839859.286232:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:3.0:1788839859.286242:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+13:15037:x1875734050233856:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788839859.286391:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+13:15037:x1875734050233856:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 150us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.286399:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:0.0:1788839859.291445:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.291533:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050233984 00000100:00100000:3.0:1788839859.291542:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050233984 00000100:00100000:3.0:1788839859.291617:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:3.0:1788839859.291628:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:15037:x1875734050233984:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788839859.291816:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:15037:x1875734050233984:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 188us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.291834:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:0.0:1788839859.294844:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.294935:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234112 00000100:00100000:1.0:1788839859.294943:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234112 00000100:00100000:1.0:1788839859.295005:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:1.0:1788839859.295014:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:15050:x1875734050234112:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839859.295155:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:15050:x1875734050234112:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 141us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.295164:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:0.0:1788839859.305026:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.305741:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234240 00000100:00100000:1.0:1788839859.305751:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234240 00000100:00100000:1.0:1788839859.305847:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:1.0:1788839859.305858:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+13:15050:x1875734050234240:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788839859.306233:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+13:15050:x1875734050234240:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 375us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.306241:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1788839859.316684:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.316763:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234368 00000100:00100000:3.0:1788839859.316812:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234368 00000100:00100000:3.0:1788839859.316859:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788839859.316867:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2388:x1875734050234368:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788839859.316894:0:17115:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5247e572-2edf-4a2d-83f4-3e72ae063b75@192.168.203.52@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1788839859.316932:0:17115:0:(genops.c:1385:class_connect()) connect: client 5247e572-2edf-4a2d-83f4-3e72ae063b75, cookie 0xad5b343a26574187 00000004:00100000:3.0:1788839859.316956:0:17115:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788839859.317037:0:17115:0:(import.c:65:import_set_state_nolock()) ffff8ab647a01000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839859.318359:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2388:x1875734050234368:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 1485us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.318374:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788839859.318380:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.318403:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234624 00000100:00100000:3.0:1788839859.318409:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234624 00000100:00100000:3.0:1788839859.318448:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1788839859.318455:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2388:x1875734050234624:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788839859.318478:0:17149:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5247e572-2edf-4a2d-83f4-3e72ae063b75@192.168.203.52@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1788839859.319621:0:17149:0:(genops.c:1385:class_connect()) connect: client 5247e572-2edf-4a2d-83f4-3e72ae063b75, cookie 0xad5b343a2657418e 00000004:00100000:3.0:1788839859.319650:0:17149:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:3.0:1788839859.319940:0:17149:0:(import.c:65:import_set_state_nolock()) ffff8ab647a05800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839859.320003:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2388:x1875734050234624:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 1545us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.320013:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788839859.332969:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839859.333046:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839859.333294:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.333331:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234752 00000100:00100000:1.0:1788839859.333354:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234752 00000100:00100000:1.0:1788839859.333422:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234496 00000100:00100000:1.0:1788839859.333425:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234496 00000100:00100000:1.0:1788839859.333448:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788839859.333458:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:0:x1875734050234752:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788839859.333494:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788839859.333561:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:0:x1875734050234752:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 104us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.333569:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788839859.333587:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1788839859.333603:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:0:x1875734050234496:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788839859.333627:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839859.333654:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:0:x1875734050234496:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 62us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.333660:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:3.0:1788839859.333912:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839859.333917:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839859.334109:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050234880 00000100:00100000:1.0:1788839859.334115:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050234880 00000100:00100000:1.0:1788839859.334148:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788839859.334155:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050234880:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788839859.334168:0:17113:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839859.334207:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050234880:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 52us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.334214:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788839859.348628:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.349387:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235008 00000100:00100000:3.0:1788839859.349398:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235008 00000100:00100000:3.0:1788839859.349463:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788839859.349474:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050235008:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788839859.349554:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050235008:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 82us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.349561:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1788839859.352950:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839859.352991:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.353012:0:17124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235392 00000100:00100000:3.0:1788839859.353023:0:17124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235392 00000100:00100000:3.0:1788839859.353087:0:17124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1788839859.353098:0:17124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050235392:12345-192.168.203.52@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788839859.353171:0:17124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050235392:12345-192.168.203.52@tcp:900:mount.lustre.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.353179:0:17124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788839859.354827:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839859.354972:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235136 00000100:00100000:1.0:1788839859.354980:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235136 00000100:00100000:1.0:1788839859.355022:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235264 00000100:00100000:1.0:1788839859.355026:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235264 00000100:00100000:1.0:1788839859.355047:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788839859.355055:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2388:x1875734050235136:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788839859.355222:0:18620:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5247e572-2edf-4a2d-83f4-3e72ae063b75@192.168.203.52@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:1.0:1788839859.355253:0:18620:0:(genops.c:1385:class_connect()) connect: client 5247e572-2edf-4a2d-83f4-3e72ae063b75, cookie 0xad5b343a26574195 00002000:00100000:1.0:1788839859.355266:0:18620:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5247e572-2edf-4a2d-83f4-3e72ae063b75/ffff8ab6479d1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788839859.355276:0:18620:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:1.0:1788839859.355351:0:18620:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1788839859.355362:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1788839859.355369:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2388:x1875734050235264:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788839859.355389:0:19600:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5247e572-2edf-4a2d-83f4-3e72ae063b75@192.168.203.52@tcp t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:3.0:1788839859.355409:0:19600:0:(genops.c:1385:class_connect()) connect: client 5247e572-2edf-4a2d-83f4-3e72ae063b75, cookie 0xad5b343a2657419c 00002000:00100000:3.0:1788839859.355414:0:19600:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5247e572-2edf-4a2d-83f4-3e72ae063b75/ffff8ab647a06000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113973 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788839859.355421:0:19600:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:3.0:1788839859.355472:0:19600:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788839859.355493:0:19600:0:(import.c:65:import_set_state_nolock()) ffff8ab647a00000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788839859.355544:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2388:x1875734050235264:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 173us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.355551:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:1.0:1788839859.355634:0:18620:0:(import.c:65:import_set_state_nolock()) ffff8ab6479d1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788839859.355757:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2388:x1875734050235136:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 613us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.355765:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1788839859.360325:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839859.360427:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235520 00000100:00100000:2.0:1788839859.360435:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235520 00000100:00100000:2.0:1788839859.360516:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1788839859.360527:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050235520:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788839859.361042:0:17117:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788839859.361129:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15037:x1875734050235520:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 603us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839859.361138:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788839859.497403:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839859.497603:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235648 00000100:00100000:3.0:1788839859.497627:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235648 00000100:00100000:3.0:1788839859.497705:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1788839859.497715:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15074:x1875734050235648:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:3.0:1788839859.497736:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839859.497759:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079000/0xad5b343a265741a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74cd1 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.497862:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.497877:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.497889:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839859.497936:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788839859.497940:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839859.497960:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.497986:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079000/0xad5b343a265741a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.498006:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839859.498014:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:3.0:1788839859.498017:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839859.498033:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078c00, rc 0) 00000100:00100000:3.0:1788839859.498091:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+7:15074:x1875734050235648:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 377us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.498098:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1788839859.583002:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839859.583054:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060797056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788839859.583124:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839859.584106:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797056 00000100:00100000:2.0:1788839859.584114:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797056 00000100:00100000:2.0:1788839859.584168:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788839859.584179:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060797056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839859.584251:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788839859.584252:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788839859.584439:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060797440:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.584479:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.584680:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060797952:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.584685:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797440 00000100:00100000:3.0:1788839859.584691:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797440 00000100:00100000:0.0:1788839859.584724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839859.584728:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788839859.584738:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060797440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.584749:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060798464:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.584804:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839859.584811:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060797440:12345-0@lo:400:kworker.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.584820:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788839859.584847:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060797440:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.584858:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797952 00000100:00100000:3.0:1788839859.584863:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797952 00000100:00100000:0.0:1788839859.584868:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788839859.584878:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060797568:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.584896:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798464 00000100:00100000:3.0:1788839859.584902:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798464 00000100:00100000:0.0:1788839859.584907:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.584929:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060798080:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.584940:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839859.584953:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.584970:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060798592:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.584989:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.585010:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797568 00000100:00100000:0.0:1788839859.585014:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797568 00000100:00100000:0.0:1788839859.585038:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798080 00000100:00100000:0.0:1788839859.585041:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798080 00000100:00100000:0.0:1788839859.585055:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788839859.585061:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060797568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.585116:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060797568:12345-0@lo:400:kworker.0 Request processed in 55us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.585122:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788839859.585135:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839859.585141:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060798080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.585171:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060798080:12345-0@lo:400:kworker.0 Request processed in 30us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.585177:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788839859.585201:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060797184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839859.585255:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060797312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839859.585392:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060797056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1214us (2265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.585401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839859.585406:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839859.585423:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060797696:0@lo:400:kworker.0 00000100:00100000:2.0:1788839859.585424:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797184 00000100:00100000:2.0:1788839859.585430:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797184 00000100:00100000:1.0:1788839859.585439:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839859.585456:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797312 00000100:00100000:2.0:1788839859.585461:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797312 00000100:00100000:1.0:1788839859.585462:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060797824:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.585465:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.585493:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060798208:0@lo:400:kworker.0 00000100:00100000:1.0:1788839859.585501:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.585524:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839859.585529:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060798336:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.585553:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060798720:0@lo:400:kworker.0 00000100:00100000:1.0:1788839859.585561:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839859.585578:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060798848:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.585588:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.585627:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797696 00000100:00100000:0.0:1788839859.585633:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797696 00000100:00100000:2.0:1788839859.585650:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788839859.585659:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060797184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839859.585663:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839859.585665:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060797824 00000100:00100000:0.0:1788839859.585671:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060797824 00000100:00100000:0.0:1788839859.585697:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798208 00000100:00100000:0.0:1788839859.585700:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798208 00000100:00100000:1.0:1788839859.585701:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00002000:00000024:2.0:1788839859.585884:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788839859.585982:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060797696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.585995:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788839859.586004:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060797824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839859.586041:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060797184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 381us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839859.586049:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788839859.586056:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060797824:12345-0@lo:400:kworker.0 Request processed in 52us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839859.586064:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788839859.586073:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060797312:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788839859.586078:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00002000:00000024:2.0:1788839859.586088:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788839859.586100:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060797696:12345-0@lo:400:kworker.0 Request processed in 388us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.586101:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788839859.586113:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060798208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839859.586119:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788839859.586125:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875734060797312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839859.586132:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788839859.586155:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060798208:12345-0@lo:400:kworker.0 Request processed in 45us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.586163:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788839859.586173:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788839859.586200:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060797568:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.586218:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060798080:0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.586236:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060797056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839859.586258:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060797952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.586287:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798592 00000100:00100000:0.0:1788839859.586292:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798592 00000100:00100000:3.0:1788839859.586307:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875734060797952:12345-0@lo:400:kworker.0 Request processed in 56us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.586314:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798336 00000100:00100000:3.0:1788839859.586317:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788839859.586319:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798336 00000100:00100000:1.0:1788839859.586333:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060797312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788839859.586339:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798720 00000100:00100000:0.0:1788839859.586342:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798848 00000100:00100000:3.0:1788839859.586345:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798720 00000100:00100000:0.0:1788839859.586347:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798848 00000100:00100000:1.0:1788839859.586352:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060797824:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.586383:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788839859.586392:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060798464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.586396:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788839859.586407:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788839859.586411:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060798592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.586430:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060798464:12345-0@lo:400:kworker.0 Request processed in 39us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.586438:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788839859.586452:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060798592:12345-0@lo:400:kworker.0 Request processed in 46us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839859.586460:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788839859.586490:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839859.586492:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839859.586494:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788839859.587002:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060797184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839859.587019:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060797696:0@lo:400:kworker.0 00000100:00100000:2.0:1788839859.587030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060798208:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.587368:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839859.587377:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788839859.587381:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060798336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.587391:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060798720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839859.587453:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060798720:12345-0@lo:400:kworker.0 Request processed in 65us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839859.587456:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060798336:12345-0@lo:400:kworker.0 Request processed in 79us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.587889:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788839859.587900:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060798848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839859.587937:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060798848:12345-0@lo:400:kworker.0 Request processed in 41us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839859.587945:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788839859.588032:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788839859.588065:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060798720:0@lo:400:kworker.0 00000100:00100000:3.0:1788839859.588083:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788839859.588100:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060798336:0@lo:400:kworker.0 00010000:00080000:0.0:1788839859.588127:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4f480 x1875734060798848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788839859.588137:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060798848:0@lo:400:kworker.0 00010000:00080000:1.0:1788839859.588317:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4ea00 x1875734060798592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839859.588404:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060798592:0@lo:400:kworker.0 00000100:00100000:1.0:1788839859.588422:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875734060797952:0@lo:400:kworker.0 00000100:00100000:1.0:1788839859.588437:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060798464:0@lo:400:kworker.0 00010000:00010000:2.0:1788839859.647960:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839859.647991:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788839860.671932:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788839861.700073:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788839862.144129:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00100000:1.0:1788839862.144143:0:19436:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000001:00100000:2.0:1788839862.145282:0:17093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00100000:2.0:1788839862.145290:0:17093:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000001:00100000:0.0:1788839862.145852:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00100000:0.0:1788839862.145859:0:18617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000001:00100000:2.0:1788839862.146097:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5247e572-2edf-4a2d-83f4-3e72ae063b75 00000001:00100000:2.0:1788839862.146105:0:17847:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of fb9a0095-2d97-404b-912c-8b552d60d900 00000001:02000400:0.0:1788839862.257832:0:19993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788839862.655157:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060798976:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788839862.655232:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839862.655717:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060798976 00000100:00100000:3.0:1788839862.655726:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060798976 00000100:00100000:3.0:1788839862.655862:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788839862.655882:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060798976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839862.655915:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788839862.655984:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060798976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 114us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839862.655992:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788839862.656451:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060798976:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788839862.656666:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788839862.720134:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839863.684184:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788839863.684208:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060799104:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788839863.684273:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839863.684320:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799104 00000100:00100000:3.0:1788839863.684328:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799104 00000100:00100000:3.0:1788839863.684382:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839863.684392:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060799104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788839863.684425:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788839863.684471:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060799104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839863.684478:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788839863.684519:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060799104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839863.686301:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060799232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788839863.686354:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839863.686407:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799232 00000100:00100000:0.0:1788839863.686412:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799232 00000100:00100000:0.0:1788839863.686448:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839863.686456:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060799232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839863.686486:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788839863.686524:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060799232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839863.686530:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788839863.686566:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777c35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060799232:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788839863.745528:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839864.514589:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514632:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514667:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514688:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514703:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514755:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514810:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514829:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514852:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839864.514895:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236288 00000100:00100000:0.0:1788839864.514904:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236288 00000100:00100000:0.0:1788839864.514964:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236800 00000100:00100000:0.0:1788839864.514968:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236800 00000100:00100000:0.0:1788839864.514983:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236160 00000100:00100000:0.0:1788839864.514986:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236160 00000100:00100000:0.0:1788839864.514998:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236672 00000100:00100000:0.0:1788839864.515000:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236672 00000100:00100000:0.0:1788839864.515017:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788839864.515026:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050236288:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515423:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236032 00000100:00100000:2.0:1788839864.515429:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236032 00000100:00100000:2.0:1788839864.515455:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236544 00000100:00100000:2.0:1788839864.515458:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236544 00000100:00100000:2.0:1788839864.515472:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235904 00000100:00100000:2.0:1788839864.515474:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235904 00000100:00100000:2.0:1788839864.515485:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236416 00000100:00100000:2.0:1788839864.515487:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236416 00000100:00100000:2.0:1788839864.515500:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788839864.515507:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050236032:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515540:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050236032:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515546:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788839864.515562:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788839864.515567:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050236544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515601:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050236544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515607:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788839864.515618:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788839864.515623:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050235904:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515643:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050235904:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515648:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1788839864.515658:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788839864.515664:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2389:x1875734050236416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515682:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2389:x1875734050236416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 19us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515696:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788839864.515719:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788839864.515738:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050236800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515763:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050236800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515786:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788839864.515799:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788839864.515804:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050236160:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515826:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050236160:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515832:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788839864.515843:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839864.515848:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050236672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839864.515880:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2389:x1875734050236672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839864.515885:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1788839864.516244:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+5:2389:x1875734050236288:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 82us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839864.516252:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1788839864.516489:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050235776 00000100:00100000:3.0:1788839864.516495:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050235776 00000100:00100000:3.0:1788839864.516536:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:3.0:1788839864.516543:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050235776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839864.516610:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+13:2389:x1875734050235776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (2036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839864.516616:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00080000:1.0:1788839864.517669:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839864.517675:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788839864.517678:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839864.517680:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839864.708639:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060799360:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.708708:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.708758:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060799872:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.708810:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.708828:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060800384:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.708860:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.708876:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060800896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.708908:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.708929:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788839864.708934:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060799744:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.708955:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.708972:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060800256:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.708992:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709008:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060800768:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709031:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709060:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060799488:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709084:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709100:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060800000:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709129:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709146:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060800512:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709164:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709176:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788839864.709181:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060799616:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709202:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709218:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060800128:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709234:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709247:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060800640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709267:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.709291:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799360 00000100:00100000:1.0:1788839864.709299:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799360 00000100:00100000:1.0:1788839864.709343:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839864.709353:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3617:x1875734060799360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709398:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3617:x1875734060799360:12345-0@lo:400:kworker.0 Request processed in 47us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709404:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788839864.709463:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799872 00000100:00100000:1.0:1788839864.709466:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799872 00000100:00100000:1.0:1788839864.709482:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800384 00000100:00100000:1.0:1788839864.709484:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800384 00000100:00100000:1.0:1788839864.709492:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800896 00000100:00100000:1.0:1788839864.709494:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800896 00000100:00100000:1.0:1788839864.709523:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800768 00000100:00100000:1.0:1788839864.709526:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800768 00000100:00100000:1.0:1788839864.709535:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800512 00000100:00100000:1.0:1788839864.709537:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800512 00000100:00100000:1.0:1788839864.709545:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800640 00000100:00100000:1.0:1788839864.709550:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800640 00000100:00100000:1.0:1788839864.709563:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788839864.709567:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060799872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709607:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875734060799872:12345-0@lo:400:kworker.0 Request processed in 40us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709613:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788839864.709624:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839864.709628:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060800384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709647:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875734060800384:12345-0@lo:400:kworker.0 Request processed in 19us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709652:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788839864.709660:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839864.709665:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060800896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709682:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875734060800896:12345-0@lo:400:kworker.0 Request processed in 17us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709686:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788839864.709694:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839864.709697:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060800768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709714:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875734060800768:12345-0@lo:400:kworker.0 Request processed in 17us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709719:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788839864.709726:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839864.709729:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060800512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709745:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060800512:12345-0@lo:400:kworker.0 Request processed in 16us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709758:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788839864.709767:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839864.709790:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060800640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709812:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875734060800640:12345-0@lo:400:kworker.0 Request processed in 22us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709817:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788839864.709837:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799744 00000100:00100000:1.0:1788839864.709840:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799744 00000100:00100000:1.0:1788839864.709860:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800256 00000100:00100000:1.0:1788839864.709862:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800256 00000100:00100000:1.0:1788839864.709871:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799616 00000100:00100000:1.0:1788839864.709873:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799616 00000100:00100000:1.0:1788839864.709881:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800128 00000100:00100000:1.0:1788839864.709882:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800128 00000100:00100000:1.0:1788839864.709892:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839864.709896:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060799744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709919:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875734060799744:12345-0@lo:400:kworker.0 Request processed in 22us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709923:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788839864.709931:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839864.709935:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060800256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709953:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060800256:12345-0@lo:400:kworker.0 Request processed in 17us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.709958:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788839864.709966:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839864.709971:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060799616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.709998:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060799616:12345-0@lo:400:kworker.0 Request processed in 27us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.710002:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788839864.710011:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839864.710015:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060800128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710031:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060800128:12345-0@lo:400:kworker.0 Request processed in 16us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.710035:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788839864.710055:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060799488 00000100:00100000:1.0:1788839864.710058:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060799488 00000100:00100000:1.0:1788839864.710079:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060800000 00000100:00100000:1.0:1788839864.710081:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060800000 00000100:00100000:1.0:1788839864.710090:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839864.710094:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060799488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710121:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875734060799488:12345-0@lo:400:kworker.0 Request processed in 26us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.710126:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788839864.710136:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788839864.710141:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060800000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710165:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060800000:12345-0@lo:400:kworker.0 Request processed in 24us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.710171:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788839864.710196:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839864.710200:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839864.710203:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839864.710204:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839864.710216:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788839864.710232:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060801024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839864.710258:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.710288:0:18625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060801024 00000100:00100000:1.0:1788839864.710291:0:18625:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060801024 00000100:00100000:1.0:1788839864.710314:0:18625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839864.710320:0:18625:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060801024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788839864.710341:0:18625:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788839864.710374:0:18625:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060801024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.710380:0:18625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788839864.710418:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060801024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788839864.710445:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060799616:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710454:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060800128:0@lo:400:kworker.0 00010000:00080000:1.0:1788839864.710466:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab7486cad80 x1875734060800640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839864.710475:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875734060800640:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710483:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060799488:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710491:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060800000:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710500:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060800512:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710533:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875734060799744:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710541:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060800256:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.710550:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875734060800768:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.717227:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060801152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839864.717301:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.721647:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060799360:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.721669:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875734060799872:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.721679:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875734060800384:0@lo:400:kworker.0 00010000:00080000:1.0:1788839864.721702:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab648267480 x1875734060800896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788839864.721712:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875734060800896:0@lo:400:kworker.0 00000100:00100000:1.0:1788839864.722533:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060801280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839864.722601:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839864.722646:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060801152 00000100:00100000:1.0:1788839864.722652:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060801152 00000100:00100000:1.0:1788839864.722681:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060801280 00000100:00100000:1.0:1788839864.722683:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060801280 00000100:00100000:1.0:1788839864.722707:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839864.722714:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060801152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788839864.722906:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788839864.722949:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060801152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 235us (5649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.722955:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788839864.722969:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839864.722974:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060801280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839864.722983:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788839864.723017:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060801280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839864.723022:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788839864.723052:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060801280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839864.723077:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060801152:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788839864.769333:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788839865.218579:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788839865.791176:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839866.823120:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788839867.019702:0:20141:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf76140e0 20000000:00000080:1.0:1788839867.019720:0:20141:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab781ea3800 uarg=0000000000000000 20000000:01000000:1.0:1788839867.019795:0:20141:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788839867.019801:0:20141:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788839867.019807:0:20141:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788839867.047045:0:20142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788839867.047238:0:20141:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788839867.065850:0:20141:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788839867.065881:0:20141:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065899:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e3f expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065909:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e4d expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065916:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573e8c expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065938:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a26573f26 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065948:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065956:0:20141:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.065964:0:20141:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.066007:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 12 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.066022:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 12 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.066037:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801408:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839867.066440:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 12 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.066449:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 12 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.066808:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801536:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839867.066850:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573f26 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.066869:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573f26 expref: 23 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.066878:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801664:0@lo:104: 00000100:00100000:0.0:1788839867.066930:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839867.066968:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573e8c expref: 23 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.066976:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573e8c expref: 23 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.066985:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801792:0@lo:104: 00000100:00100000:0.0:1788839867.067004:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839867.067028:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573e4d expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.067036:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573e4d expref: 23 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.067043:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801920:0@lo:104: 00000100:00100000:0.0:1788839867.067061:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839867.067076:0:20141:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xad5b343a26573e3f expref: 23 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.067084:0:20141:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xad5b343a26573e3f expref: 23 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.067091:0:20141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060802048:0@lo:104: 00000100:00100000:0.0:1788839867.067116:0:20141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839867.067126:0:20141:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777f96240 going to sleep for 11 seconds 00000100:00100000:0.0:1788839867.067163:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060801664 00000100:00100000:0.0:1788839867.067170:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060801664 00000100:00100000:0.0:1788839867.067206:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060801792 00000100:00100000:0.0:1788839867.067209:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060801792 00000100:00100000:0.0:1788839867.067219:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060801920 00000100:00100000:0.0:1788839867.067221:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060801920 00000100:00100000:0.0:1788839867.067231:0:17097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802048 00000100:00100000:0.0:1788839867.067233:0:17097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802048 00000100:00100000:0.0:1788839867.067245:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839867.067253:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+6:20141:x1875734060801664:12345-0@lo:104: 00010000:00010000:0.0:1788839867.067265:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.067314:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839867.067320:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+6:20141:x1875734060801664:12345-0@lo:104: Request processed in 68us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839867.067327:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788839867.067342:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839867.067348:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+5:20141:x1875734060801792:12345-0@lo:104: 00010000:00010000:0.0:1788839867.067355:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.067384:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788839867.067389:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+5:20141:x1875734060801792:12345-0@lo:104: Request processed in 42us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839867.067394:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788839867.067405:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839867.067417:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:20141:x1875734060801920:12345-0@lo:104: 00010000:00010000:0.0:1788839867.067424:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.067452:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1788839867.070237:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788839867.070249:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070261:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839867.070266:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070278:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839867.070285:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839867.070290:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839867.070337:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070344:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839867.070375:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070382:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab75e553600/0xad5b343a26573f26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573f2d expref: -99 pid: 19435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070399:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788839867.070415:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070420:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfd400 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839867.070424:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070430:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839867.070436:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839867.070441:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839867.070453:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070473:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839867.070488:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070494:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647bfd400/0xad5b343a26573e8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e93 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070505:0:17101:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788839867.070508:0:17101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070513:0:17101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647843200 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:3.0:1788839867.070516:0:17101:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070534:0:17101:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788839867.070647:0:17101:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788839867.070654:0:17101:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788839867.070668:0:17101:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070674:0:17101:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788839867.070681:0:17101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070687:0:17101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647843200/0xad5b343a26573e4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e54 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070697:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839867.070699:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788839867.070701:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839867.070710:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839867.070729:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060802176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788839867.070810:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839867.070861:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802176 00000100:00100000:3.0:1788839867.070867:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802176 00010000:00010000:3.0:1788839867.070893:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573f26 expref: 24 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839867.070920:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839867.070935:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3616:x1875734060802176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839867.070948:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839867.070954:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573f26 expref: 24 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070964:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573f26 expref: 24 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.070981:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839867.071013:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3616:x1875734060802176:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839867.071019:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788839867.071058:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060802176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839867.071166:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+4:20141:x1875734060801920:12345-0@lo:104: Request processed in 41us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839867.071176:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788839867.071193:0:17097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788839867.071200:0:17097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:20141:x1875734060802048:12345-0@lo:104: 00010000:00010000:0.0:1788839867.071209:0:17097:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.071246:0:17097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788839867.071251:0:17097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+3:20141:x1875734060802048:12345-0@lo:104: Request processed in 52us (4134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839867.071257:0:17097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788839867.071271:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839867.071276:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.071282:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647bfce00 already unused, calling callback (ffffffffc1387c20) 10000000:00010000:0.0:1788839867.071285:0:18648:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.071293:0:18648:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788839867.071299:0:18648:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839867.071311:0:18648:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788839867.071327:0:18648:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.071332:0:18648:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788839867.071341:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.071347:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff8ab647bfce00/0xad5b343a26573e3f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xad5b343a26573e46 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839867.071358:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839867.071360:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839867.071362:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839867.071387:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552000/0xad5b343a26573f2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573f26 expref: 23 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.071397:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801664:0@lo:104: 00000100:00100000:0.0:1788839867.071406:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801792:0@lo:104: 00000100:00100000:0.0:1788839867.071413:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801920:0@lo:104: 00000100:00100000:0.0:1788839867.071418:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060802048:0@lo:104: 00000100:00100000:0.0:1788839867.071447:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788839867.071455:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060802560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839867.073216:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788839867.073260:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839867.073284:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060802304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839867.073303:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839867.073332:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788839867.073338:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060802432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839867.073356:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839867.073441:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802560 00000100:00100000:3.0:1788839867.073448:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802560 00000100:00100000:2.0:1788839867.074150:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802304 00000100:00100000:2.0:1788839867.074156:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802304 00010000:00010000:2.0:1788839867.074184:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e8c expref: 24 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839867.074203:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802432 00000100:00100000:2.0:1788839867.074206:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802432 00010000:00010000:2.0:1788839867.074217:0:17098:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e4d expref: 25 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839867.074240:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839867.074248:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+25:3614:x1875734060802304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839867.074261:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839867.074267:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e8c expref: 25 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.074278:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573e8c expref: 25 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.074294:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab75e552e00/0xad5b343a26573e93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573e8c expref: 25 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.074309:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839867.074352:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060802304:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839867.074359:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788839867.074375:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788839867.074380:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:3614:x1875734060802432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788839867.074387:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839867.074391:0:17098:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e4d expref: 23 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.074398:0:17098:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573e4d expref: 23 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.074407:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647bfd200/0xad5b343a26573e54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573e4d expref: 23 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.074424:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839867.074449:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:3614:x1875734060802432:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839867.074454:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788839867.074954:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e3f expref: 21 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839867.074975:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788839867.074983:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:3617:x1875734060802560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788839867.074992:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839867.074997:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xad5b343a26573e3f expref: 21 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.075005:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xad5b343a26573e3f expref: 21 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.075015:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647842c00/0xad5b343a26573e46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xad5b343a26573e3f expref: 21 pid: 17108 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839867.075035:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839867.075068:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:3617:x1875734060802560:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839867.075074:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788839867.075101:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839867.075361:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4b73860-6950-4a5d-8d03-52a643e5ff43:3617:1875734060802560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839867.075480:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060802432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788839867.075489:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060802304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788839867.078029:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801408:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839867.078045:0:20141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20141:1875734060801536:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839867.078081:0:20141:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839867.079797:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839867.079874:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839867.079947:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050236928 00000100:00100000:2.0:1788839867.079955:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050236928 00010000:00010000:2.0:1788839867.079989:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 13 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839867.080022:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237056 00000100:00100000:2.0:1788839867.080025:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237056 00010000:00010000:2.0:1788839867.080035:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 14 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839867.080049:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788839867.080056:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccda0330-6550-4161-8186-8c642452683e+14:2390:x1875734050236928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839867.080069:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839867.080074:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 14 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080084:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 14 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080119:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab647958000/0xad5b343a26574180 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ca0 expref: 14 pid: 17107 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080134:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839867.080182:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccda0330-6550-4161-8186-8c642452683e+13:2390:x1875734050236928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 125us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839867.080190:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788839867.080232:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788839867.080239:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccda0330-6550-4161-8186-8c642452683e+12:2390:x1875734050237056:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839867.080246:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839867.080250:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 12 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080258:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 12 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080268:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab781e68e00/0xad5b343a26574141 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c30 expref: 12 pid: 17105 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080277:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080285:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080298:0:17100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080316:0:17100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080322:0:17100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080328:0:17100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080334:0:17100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839867.080338:0:17100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080345:0:17100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080359:0:17100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080369:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839867.080393:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccda0330-6550-4161-8186-8c642452683e+11:2390:x1875734050237056:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 154us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839867.080399:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:2.0:1788839867.080421:0:20141:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080428:0:20141:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839867.080433:0:20141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab781e68200/0xad5b343a265741b1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20141 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839867.778994:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060802688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788839867.779066:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839867.787573:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802688 00000100:00100000:3.0:1788839867.787590:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802688 00000100:00100000:3.0:1788839867.787675:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839867.787690:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060802688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839867.787724:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788839867.787826:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875734060802688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (8759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839867.787833:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788839867.787904:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875734060802688:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788839867.788007:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788839867.844244:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788839868.799038:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788839868.799063:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060802816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839868.799142:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.799293:0:17118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802816 00000100:00100000:0.0:1788839868.799302:0:17118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802816 00000100:00100000:0.0:1788839868.799356:0:17118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839868.799365:0:17118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060802816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839868.799396:0:17118:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788839868.799443:0:17118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060802816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839868.799450:0:17118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788839868.799500:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060802816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839868.800123:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839868.800137:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060802944:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839868.800171:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839868.800287:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060802944 00000100:00100000:1.0:1788839868.800292:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060802944 00000100:00100000:1.0:1788839868.800333:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788839868.800341:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060802944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788839868.800361:0:18138:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788839868.800398:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060802944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839868.800405:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788839868.800734:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648267480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060802944:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788839868.864100:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839868.903914:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839868.903948:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237184 00000100:00100000:2.0:1788839868.903958:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237184 00000100:00100000:2.0:1788839868.904039:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:2.0:1788839868.904050:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+11:14921:x1875734050237184:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839868.904067:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839868.904086:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de7c00/0xad5b343a265741b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74cd8 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.904561:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de7c00/0xad5b343a265741b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd8 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.904575:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de7c00/0xad5b343a265741b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd8 expref: 12 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.904583:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7c00, rc 0) 00000100:00100000:2.0:1788839868.904643:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+12:14921:x1875734050237184:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 595us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.904651:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:1.0:1788839868.912275:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839868.912352:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237312 00000100:00100000:3.0:1788839868.912362:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237312 00000100:00100000:3.0:1788839868.912415:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:3.0:1788839868.912425:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+12:14921:x1875734050237312:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839868.912597:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccda0330-6550-4161-8186-8c642452683e+12:14921:x1875734050237312:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 172us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839868.912606:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:0.0:1788839868.914693:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839868.914902:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237440 00000100:00100000:2.0:1788839868.914911:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237440 00000100:00100000:2.0:1788839868.915052:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:2.0:1788839868.915062:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab77f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+12:14921:x1875734050237440:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.915198:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab77f9dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+12:14921:x1875734050237440:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 137us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.915205:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:0.0:1788839868.923317:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839868.925322:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237568 00000100:00100000:2.0:1788839868.925335:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237568 00000100:00100000:2.0:1788839868.925395:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:2.0:1788839868.925405:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+12:14921:x1875734050237568:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839868.925420:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839868.925438:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6000/0xad5b343a265741bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74cdf expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.925466:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6000/0xad5b343a265741bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cdf expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.925476:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6000/0xad5b343a265741bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cdf expref: 13 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.925485:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6000, rc 0) 00000100:00100000:2.0:1788839868.925557:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccda0330-6550-4161-8186-8c642452683e+13:14921:x1875734050237568:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 153us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.925564:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 10000000:01000000:2.0:1788839868.927211:0:17110:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788839868.927215:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab778bee800 from 13 10000000:01000000:2.0:1788839868.927219:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788839868.927266:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.927277:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.927287:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839868.927311:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.927375:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839868.927422:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab77e487a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839868.927427:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803072 00000100:00100000:3.0:1788839868.927439:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803072 00000100:00100000:3.0:1788839868.927495:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788839868.927504:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+20:17110:x1875734060803072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788839868.927517:0:17108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839868.927537:0:17108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab782079000/0xad5b343a265741cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265741c6 expref: -99 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839868.927571:0:17108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab782079000/0xad5b343a265741cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265741c6 expref: 21 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839868.927580:0:17108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab782079000/0xad5b343a265741cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265741c6 expref: 21 pid: 17108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839868.927587:0:17108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079000, rc 0) 00000100:00100000:3.0:1788839868.927633:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060803072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839868.927639:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788839868.927935:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839868.927951:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.927960:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839868.928031:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.928059:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.928076:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51480 going to sleep for 11 seconds 00000100:00100000:3.0:1788839868.928180:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803200 00000100:00100000:3.0:1788839868.928185:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803200 00000100:00100000:3.0:1788839868.928217:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788839868.928224:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060803200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788839868.928341:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060803200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839868.928348:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788839868.928462:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.928501:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.929510:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.929556:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839868.929654:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803328 00000100:00100000:2.0:1788839868.929661:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803328 00000100:00100000:2.0:1788839868.929710:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788839868.929718:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060803328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.930089:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780016850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060803328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 371us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.930097:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788839868.930278:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839868.931301:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839868.931517:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237696 00000100:00100000:2.0:1788839868.931524:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237696 00000100:00100000:2.0:1788839868.931611:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:2.0:1788839868.931621:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:14921:x1875734050237696:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.931796:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:14921:x1875734050237696:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 176us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.931804:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000040:00080000:3.0:1788839868.933434:0:20220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788839868.933667:0:17110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788839868.933693:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839868.933705:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.933717:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab777de6c00/0xad5b343a265741c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741cd expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839868.933738:0:17110:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839868.933741:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab75e47c000 from 13 10000000:01000000:0.0:1788839868.933744:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839868.933798:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.933807:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.933817:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839868.933855:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.933911:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.933954:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839868.934131:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803456 00000100:00100000:2.0:1788839868.934138:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803456 00000100:00100000:2.0:1788839868.934192:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788839868.934200:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+21:17110:x1875734060803456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839868.934213:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839868.934225:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab777de6a00/0xad5b343a265741db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265741d4 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.934247:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab777de6a00/0xad5b343a265741db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265741d4 expref: 22 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.934257:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab777de6a00/0xad5b343a265741db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265741d4 expref: 22 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.934266:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6a00, rc 0) 00000100:00100000:2.0:1788839868.934312:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060803456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.934319:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788839868.935539:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839868.935568:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.935578:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839868.935648:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.935911:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.935947:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51480 going to sleep for 11 seconds 00000100:00100000:3.0:1788839868.936008:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803584 00000100:00100000:3.0:1788839868.936014:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803584 00000100:00100000:3.0:1788839868.936055:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788839868.936063:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060803584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.936109:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839868.936212:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060803584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 149us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839868.936219:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788839868.936229:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.936242:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237824 00000100:00100000:2.0:1788839868.936247:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237824 00000100:00100000:2.0:1788839868.936269:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:2.0:1788839868.936275:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:14921:x1875734050237824:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.936361:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:14921:x1875734050237824:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.936368:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:0.0:1788839868.936441:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.936491:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.936510:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51480 going to sleep for 11 seconds 00000100:00100000:2.0:1788839868.936576:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803712 00000100:00100000:2.0:1788839868.936581:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803712 00000100:00100000:2.0:1788839868.936597:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788839868.936603:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060803712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.936691:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060803712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.936698:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788839868.936796:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788839868.942526:0:20221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788839868.942870:0:17110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788839868.942897:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788839868.942910:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.943704:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e69600/0xad5b343a265741d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741db expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788839868.943716:0:17110:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788839868.943719:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab7479d8000 from 13 10000000:01000000:1.0:1788839868.943722:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788839868.943758:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.943767:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.943848:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839868.943873:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788839868.944006:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839868.944143:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab746355780 going to sleep for 11 seconds 00000100:00100000:2.0:1788839868.944186:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803840 00000100:00100000:2.0:1788839868.944193:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803840 00000100:00100000:1.0:1788839868.944436:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788839868.944450:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+22:17110:x1875734060803840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839868.944466:0:17107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839868.944479:0:17107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959400/0xad5b343a265741e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265741e2 expref: -99 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.944505:0:17107:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959400/0xad5b343a265741e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265741e2 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.944515:0:17107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959400/0xad5b343a265741e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265741e2 expref: 23 pid: 17107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.944531:0:17107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959400, rc 0) 00000100:00100000:1.0:1788839868.944688:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060803840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 241us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839868.944696:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788839868.944709:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648264380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788839868.944728:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.944740:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839868.944819:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.944847:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839868.944869:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839868.944955:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060803968 00000100:00100000:1.0:1788839868.944959:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060803968 00000100:00100000:1.0:1788839868.945138:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788839868.945146:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060803968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788839868.945256:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060803968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839868.945263:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788839868.945348:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060803968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.945436:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.945556:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839868.945582:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab74764bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839868.945595:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804096 00000100:00100000:1.0:1788839868.945600:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804096 00000100:00100000:1.0:1788839868.945629:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788839868.945635:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060804096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788839868.945734:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060804096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839868.945752:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788839868.945825:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839868.947411:0:20223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788839868.947570:0:17110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788839868.947606:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788839868.947624:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.947663:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab647958a00/0xad5b343a265741e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741e9 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788839868.947675:0:17110:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788839868.947677:0:17110:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8ab64817e800 from 13 10000000:01000000:0.0:1788839868.947680:0:17110:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788839868.947719:0:17110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.947728:0:17110:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.947738:0:17110:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839868.947767:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.947865:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.947905:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788839868.948108:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804224 00000100:00100000:1.0:1788839868.948115:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804224 00000100:00100000:1.0:1788839868.948240:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788839868.948249:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+23:17110:x1875734060804224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788839868.948274:0:17105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839868.948287:0:17105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab647959000/0xad5b343a265741f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xad5b343a265741f0 expref: -99 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.948310:0:17105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab647959000/0xad5b343a265741f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xad5b343a265741f0 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.948320:0:17105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab647959000/0xad5b343a265741f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xad5b343a265741f0 expref: 24 pid: 17105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839868.948329:0:17105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959000, rc 0) 00000100:00100000:1.0:1788839868.948365:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780017850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060804224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839868.948372:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788839868.948619:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788839868.948633:0:17110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839868.948642:0:17110:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839868.948697:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.948724:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.948756:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839868.948816:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804352 00000100:00100000:2.0:1788839868.948821:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804352 00000100:00100000:2.0:1788839868.948853:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788839868.948862:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060804352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.949103:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780014850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060804352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.949120:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788839868.949402:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.949431:0:17110:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788839868.949471:0:17110:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839868.949499:0:17110:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab777e51d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788839868.949528:0:17107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804480 00000100:00100000:2.0:1788839868.949533:0:17107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804480 00000100:00100000:2.0:1788839868.949575:0:17107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788839868.949583:0:17107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060804480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788839868.949671:0:17107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:17110:x1875734060804480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839868.949679:0:17107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788839868.949790:0:17110:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4b73860-6950-4a5d-8d03-52a643e5ff43:17110:1875734060804480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788839868.954641:0:20224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788839868.954826:0:17110:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788839868.954852:0:17110:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788839868.954865:0:17110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839868.954877:0:17110:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff8ab781e69c00/0xad5b343a265741f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xad5b343a265741f7 expref: -99 pid: 17110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839869.617083:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839869.617166:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839869.617199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839869.617247:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238336 00000100:00100000:2.0:1788839869.617256:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238336 00000100:00100000:2.0:1788839869.617326:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1788839869.617336:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+5:2392:x1875734050238336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1788839869.617337:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839869.617413:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+5:2392:x1875734050238336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.617420:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1788839869.622686:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839869.622726:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839869.622802:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238848 00000100:00100000:3.0:1788839869.622821:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238848 00000100:00100000:3.0:1788839869.622883:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1788839869.622893:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2392:x1875734050238848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1788839869.622971:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2392:x1875734050238848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839869.622978:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:3.0:1788839869.622999:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788839869.626114:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238080 00000100:00100000:1.0:1788839869.626129:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238080 00000100:00100000:1.0:1788839869.626216:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238592 00000100:00100000:1.0:1788839869.626220:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238592 00000100:00100000:1.0:1788839869.626249:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1788839869.626259:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2392:x1875734050238080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839869.626341:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2392:x1875734050238080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 84us (9268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839869.626350:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1788839869.626369:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1788839869.626375:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2392:x1875734050238592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839869.626416:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2392:x1875734050238592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (9217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839869.626422:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1788839869.627091:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839869.627119:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839869.627141:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839869.627164:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238208 00000100:00100000:0.0:1788839869.627169:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238208 00000100:00100000:0.0:1788839869.627200:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238720 00000100:00100000:0.0:1788839869.627204:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238720 00000100:00100000:0.0:1788839869.627222:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788839869.627229:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2392:x1875734050238208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839869.627265:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2392:x1875734050238208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.627272:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1788839869.627285:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788839869.627290:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2392:x1875734050238720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839869.627313:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2392:x1875734050238720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.627331:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788839869.627348:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050237952 00000100:00100000:0.0:1788839869.627352:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050237952 00000100:00100000:0.0:1788839869.627371:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238464 00000100:00100000:0.0:1788839869.627373:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238464 00000100:00100000:0.0:1788839869.627401:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788839869.627407:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+6:2392:x1875734050237952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839869.627434:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+6:2392:x1875734050237952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (4708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.627441:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1788839869.627528:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1788839869.627535:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2392:x1875734050238464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1788839869.627570:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2392:x1875734050238464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.627576:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00080000:3.0:1788839869.628688:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788839869.628697:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788839869.628700:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788839869.823323:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab648265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060804608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788839869.823391:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839869.823439:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804608 00000100:00100000:1.0:1788839869.823456:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804608 00000100:00100000:1.0:1788839869.823508:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839869.823516:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060804608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788839869.823611:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788839869.823656:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060804608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839869.823663:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788839869.823709:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab648265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060804608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788839869.823859:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839869.823880:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060804736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839869.823909:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788839869.823933:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788839869.823942:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060805120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.823967:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839869.823984:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060805632:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.824002:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804736 00000100:00100000:2.0:1788839869.824004:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839869.824006:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804736 00000100:00100000:2.0:1788839869.824017:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060806144:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824039:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839869.824048:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788839869.824054:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060804736:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839869.824056:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788839869.824061:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060805248:0@lo:400:kworker.0 00002000:00000024:3.0:1788839869.824070:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788839869.824079:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839869.824095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060805760:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.824096:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060804736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839869.824102:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788839869.824113:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839869.824119:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060804864:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824125:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060806272:0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.824203:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060804992:0@lo:400:kworker.0 00000100:00100000:1.0:1788839869.824248:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060806144 00000100:00100000:1.0:1788839869.824252:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060806144 00000100:00100000:1.0:1788839869.824279:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805248 00000100:00100000:1.0:1788839869.824281:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805248 00000100:00100000:1.0:1788839869.824292:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805760 00000100:00100000:1.0:1788839869.824294:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805760 00000100:00100000:1.0:1788839869.824305:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788839869.824311:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060806144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824357:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839869.824381:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060804736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839869.824406:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805120 00000100:00100000:2.0:1788839869.824410:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805120 00000100:00100000:2.0:1788839869.824434:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805632 00000100:00100000:2.0:1788839869.824436:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805632 00000100:00100000:2.0:1788839869.824454:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839869.824460:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060805120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824504:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060805120:12345-0@lo:400:kworker.0 Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.824511:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788839869.824522:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839869.824528:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060805632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824573:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060805632:12345-0@lo:400:kworker.0 Request processed in 46us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.824580:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788839869.824596:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060806272 00000100:00100000:2.0:1788839869.824599:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060806272 00000100:00100000:2.0:1788839869.824613:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839869.824618:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060805248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824641:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060805248:12345-0@lo:400:kworker.0 Request processed in 23us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.824648:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788839869.824658:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839869.824662:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060805760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824680:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060805760:12345-0@lo:400:kworker.0 Request processed in 18us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.824686:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788839869.824694:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839869.824699:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060806272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824717:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060806272:12345-0@lo:400:kworker.0 Request processed in 18us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.824722:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839869.824747:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060805248:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824756:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060805760:0@lo:400:kworker.0 00010000:00080000:2.0:1788839869.824766:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4e300 x1875734060806272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839869.824817:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060806272:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824829:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060805120:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.824836:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060805632:0@lo:400:kworker.0 00000100:00080000:2.0:1788839869.824873:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788839869.824876:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839869.824878:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839869.824880:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788839869.827544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839869.827621:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060805376:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.827677:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839869.827914:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804864 00000100:00100000:2.0:1788839869.827922:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804864 00000100:00100000:2.0:1788839869.828222:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788839869.831574:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060804864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.831667:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780015450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3614:x1875734060804864:12345-0@lo:400:kworker.0 Request processed in 116us (4136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839869.831677:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788839869.831964:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060805888:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.832004:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839869.832089:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839869.832126:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060805504:0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.832150:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839869.832168:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060806016:0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.832205:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805376 00000100:00100000:0.0:1788839869.832212:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805376 00000100:00100000:0.0:1788839869.832249:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060804992 00000100:00100000:0.0:1788839869.832263:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060804992 00000100:00100000:0.0:1788839869.832279:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788839869.832298:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060805376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.832342:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060805376:12345-0@lo:400:kworker.0 Request processed in 45us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.832349:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788839869.832363:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839869.832369:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060804992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.832402:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060804992:12345-0@lo:400:kworker.0 Request processed in 33us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.832407:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788839869.832463:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805504 00000100:00100000:0.0:1788839869.832467:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805504 00000100:00100000:0.0:1788839869.832514:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788839869.832521:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060805504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.832747:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060805504:12345-0@lo:400:kworker.0 Request processed in 225us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.832754:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788839869.832788:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839869.833396:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875734060806144:12345-0@lo:400:kworker.0 Request processed in 9082us (9352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839869.833405:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788839869.833485:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875734060806144:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.836259:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab646b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060806400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788839869.836322:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839869.836359:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4b73860-6950-4a5d-8d03-52a643e5ff43:3614:1875734060804864:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.836372:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060805376:0@lo:400:kworker.0 00000100:00100000:3.0:1788839869.836414:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060806400 00000100:00100000:3.0:1788839869.836420:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060806400 00000100:00100000:2.0:1788839869.836634:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839869.837124:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839869.837136:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060806400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788839869.837180:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788839869.837228:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060806400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839869.837235:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788839869.837273:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab646b59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060806400:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788839869.842133:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060805888 00000100:00100000:1.0:1788839869.842165:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060805888 00000100:00100000:1.0:1788839869.842247:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788839869.842268:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060805888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788839869.842383:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875734060805888:12345-0@lo:400:kworker.0 Request processed in 118us (10377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839869.842391:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788839869.842767:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788839869.842835:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875734060805888:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.844482:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060804992:0@lo:400:kworker.0 00000100:00100000:2.0:1788839869.844499:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060805504:0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.844984:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060806016 00000100:00100000:0.0:1788839869.844992:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060806016 00000100:00100000:0.0:1788839869.845061:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839869.845069:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6478ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060806016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788839869.845152:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6478ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060806016:12345-0@lo:400:kworker.0 Request processed in 84us (8518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839869.845159:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788839869.845375:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788839869.846373:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a4d880 x1875734060806016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839869.846389:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060806016:0@lo:400:kworker.0 00010000:00010000:3.0:1788839869.887145:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788839869.889513:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788839870.447239:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839870.447378:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050238976 00000100:00100000:0.0:1788839870.447403:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050238976 00000100:00100000:0.0:1788839870.447588:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839870.447613:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+6:15590:x1875734050238976:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839870.447636:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839870.447667:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265741fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ce6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447728:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447743:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447759:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447799:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447807:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447815:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447892:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68000/0xad5b343a26574213 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447900:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68000/0xad5b343a26574213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.447907:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68000/0xad5b343a26574213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839870.447953:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788839870.447956:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839870.447992:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68000/0xad5b343a26574213 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448003:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448011:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448018:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448025:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839870.448030:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448038:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448049:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:0.0:1788839870.448052:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.448057:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448072:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448085:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448101:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448108:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448114:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839870.448117:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448124:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448131:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab647853700) 00010000:00010000:0.0:1788839870.448134:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.448137:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448143:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a2657420c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448174:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265741fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ce6 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448188:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68000/0xad5b343a26574213 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ce6 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.448197:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647853000) 00010000:00010000:0.0:1788839870.448199:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839870.448206:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68000, rc 0) 00000100:00100000:0.0:1788839870.448693:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+7:15590:x1875734050238976:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1078us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839870.448702:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839870.452289:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.452360:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050239104 00000100:00100000:2.0:1788839870.452369:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050239104 00000100:00100000:2.0:1788839870.452419:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788839870.452436:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb9a0095-2d97-404b-912c-8b552d60d900+7:15590:x1875734050239104:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788839870.452529:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb9a0095-2d97-404b-912c-8b552d60d900+7:15590:x1875734050239104:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 88us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.452545:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788839870.460712:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839870.460801:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050239360 00000100:00100000:0.0:1788839870.460811:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050239360 00000100:00100000:0.0:1788839870.460866:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788839870.460876:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+7:15590:x1875734050239360:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839870.460896:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839870.460916:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a2657421a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74ced expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.460992:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461006:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461017:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461073:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461081:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461088:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461207:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69400/0xad5b343a2657422f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461216:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69400/0xad5b343a2657422f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461224:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69400/0xad5b343a2657422f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839870.461233:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788839870.461388:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461396:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461404:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461410:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839870.461415:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461423:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461437:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab647853000) 00010000:00010000:0.0:1788839870.461440:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.461444:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461460:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574221 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461474:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461480:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461487:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461493:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839870.461496:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461503:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461509:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab647853700) 00010000:00010000:0.0:1788839870.461512:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.461514:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.461521:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a26574228 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.464622:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a2657421a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ced expref: 10 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.464665:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69400/0xad5b343a2657422f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74ced expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.464675:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab647853d00) 00010000:00010000:0.0:1788839870.464678:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.464682:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e69400, rc 0) 00000100:00100000:0.0:1788839870.464758:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+9:15590:x1875734050239360:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3883us (4054us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788839870.464793:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788839870.482937:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.483241:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050239488 00000100:00100000:2.0:1788839870.483251:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050239488 00000100:00100000:2.0:1788839870.483306:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1788839870.483317:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+9:15590:x1875734050239488:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788839870.483427:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+9:15590:x1875734050239488:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 111us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.483435:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1788839870.503817:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.503897:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050239616 00000100:00100000:2.0:1788839870.503907:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050239616 00000100:00100000:2.0:1788839870.503956:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1788839870.503967:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:15590:x1875734050239616:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788839870.513925:0:17115:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 9918us 00000100:00100000:3.0:1788839870.537628:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:15590:x1875734050239616:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 33653us (33854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839870.537643:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1788839870.548145:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.548234:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050239744 00000100:00100000:2.0:1788839870.548244:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050239744 00000100:00100000:2.0:1788839870.548387:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1788839870.548401:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+9:15596:x1875734050239744:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839870.548430:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.548451:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657423d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74cf4 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548512:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548559:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548571:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548586:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548594:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548600:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548645:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548653:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548660:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548667:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839870.548671:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548680:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548693:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.548702:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.548707:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548713:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a26574244 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548724:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548730:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548735:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548740:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839870.548743:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548749:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548755:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab646802b00) 00010000:00010000:2.0:1788839870.548758:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.548760:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548765:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657424b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548816:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657423d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cf4 expref: 10 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548832:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.548834:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.548838:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a2657423d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cf4 expref: 10 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.548846:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7e00, rc 0) 00000100:00100000:2.0:1788839870.552882:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+9:15596:x1875734050239744:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 4472us (4733us total) trans 0 rc 301/301 00000100:00100000:2.0:1788839870.552896:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1788839870.559505:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.560859:0:17122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050239872 00000100:00100000:2.0:1788839870.560874:0:17122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050239872 00000100:00100000:2.0:1788839870.560986:0:17122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1788839870.560996:0:17122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb9a0095-2d97-404b-912c-8b552d60d900+9:15596:x1875734050239872:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:2.0:1788839870.561083:0:17122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb9a0095-2d97-404b-912c-8b552d60d900+9:15596:x1875734050239872:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 89us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.561091:0:17122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788839870.566361:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839870.566481:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050240128 00000100:00100000:1.0:1788839870.566491:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050240128 00000100:00100000:1.0:1788839870.566886:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1788839870.566898:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab646b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+9:15596:x1875734050240128:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1788839870.566948:0:17113:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839870.566983:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657416b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74c61 expref: 9 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.567003:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:1.0:1788839870.567007:0:17113:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839870.567059:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.567071:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 5 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.567080:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.567120:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 5 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.567133:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 5 pid: 17149 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839870.567157:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060806528:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839870.567229:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744455900 going to sleep for 11 seconds 00000100:00100000:2.0:1788839870.570638:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7486c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060806528:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839870.570689:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839870.573304:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.573383:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050240256 00000100:00100000:2.0:1788839870.573393:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050240256 00010000:00010000:2.0:1788839870.573445:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 6 pid: 17149 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839870.573485:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788839870.573510:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2390:x1875734050240256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839870.573543:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839870.573551:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 6 pid: 17149 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.573564:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 6 pid: 17149 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.573587:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265741aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cd1 expref: 6 pid: 17149 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.573602:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.573607:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.573616:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.573624:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.573662:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839870.573721:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2390:x1875734050240256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 213us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.573729:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:1.0:1788839870.573802:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.573811:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.573834:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.573844:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839870.573852:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.578496:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.578519:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.578546:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839870.578570:0:17113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000518662e2 reply state 00000000e23d2fe4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.578581:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.578588:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:2.0:1788839870.579805:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839870.579811:0:17113:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788839870.579819:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839870.579832:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579841:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579848:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579854:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839870.579858:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579866:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579880:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.579883:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.579899:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579905:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574252 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839870.579925:0:17113:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000518662e2 reply state 00000000e23d2fe4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579936:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.579942:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab7750d2f00) 00010000:00010000:2.0:1788839870.579945:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839870.579947:0:17113:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788839870.580212:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab646b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+10:15596:x1875734050240128:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 13311us (13853us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788839870.580222:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1788839870.700188:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.700442:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050240384 00000100:00100000:2.0:1788839870.700453:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050240384 00000100:00100000:2.0:1788839870.700616:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1788839870.700627:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+10:15604:x1875734050240384:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1788839870.700658:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.700680:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574267 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74cfb expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.700969:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a2657426e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.700982:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a2657426e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.701010:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a2657426e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839870.701049:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839870.701052:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839870.701087:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a2657426e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.701109:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574267 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cfb expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.701127:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7a00/0xad5b343a2657426e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74cfb expref: 11 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.701135:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.701164:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839870.701168:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7a00, rc 0) 00000100:00100000:2.0:1788839870.701282:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+11:15604:x1875734050240384:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 657us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.701290:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1788839870.739404:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839870.739488:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050240512 00000100:00100000:3.0:1788839870.739498:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050240512 00000100:00100000:3.0:1788839870.739573:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788839870.739584:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:15605:x1875734050240512:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1788839870.739616:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839870.739640:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a26574275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d02 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.740198:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078e00/0xad5b343a2657427c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.740214:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078e00/0xad5b343a2657427c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.740225:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078e00/0xad5b343a2657427c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839870.740267:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788839870.740271:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839870.740292:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078e00/0xad5b343a2657427c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.740317:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a26574275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d02 expref: 7 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.740335:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078e00/0xad5b343a2657427c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d02 expref: 6 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.740343:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:3.0:1788839870.740358:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788839870.740362:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078e00, rc 0) 00000100:00100000:3.0:1788839870.740427:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15605:x1875734050240512:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 844us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839870.740434:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1788839870.744012:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839870.744251:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050240640 00000100:00100000:0.0:1788839870.744260:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050240640 00000100:00100000:0.0:1788839870.744322:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788839870.744332:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:15605:x1875734050240640:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1788839870.744353:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839870.744373:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574283 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d09 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744437:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744452:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744480:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744493:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744501:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744507:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744610:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68200/0xad5b343a26574298 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744619:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68200/0xad5b343a26574298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744626:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68200/0xad5b343a26574298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839870.744664:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788839870.744668:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839870.744702:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68200/0xad5b343a26574298 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744715:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744722:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744738:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744743:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839870.744747:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744756:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744916:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:0.0:1788839870.744921:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.744926:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744933:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657428a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744946:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744953:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.744959:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745032:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839870.745036:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745053:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745062:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab7750d2f00) 00010000:00010000:0.0:1788839870.745064:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839870.745067:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745073:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a26574291 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745101:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574283 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d09 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745114:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68200/0xad5b343a26574298 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d09 expref: 7 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.745120:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:0.0:1788839870.745122:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788839870.745125:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68200, rc 0) 00000100:00100000:0.0:1788839870.745183:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+7:15605:x1875734050240640:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 851us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839870.745191:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1788839870.749101:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.749193:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050240768 00000100:00100000:2.0:1788839870.749202:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050240768 00000100:00100000:2.0:1788839870.749263:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788839870.749273:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:15605:x1875734050240768:12345-192.168.203.52@tcp:900:lfs.0 00000100:00100000:2.0:1788839870.749357:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:15605:x1875734050240768:12345-192.168.203.52@tcp:900:lfs.0 Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.749364:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1788839870.753643:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.753980:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050241024 00000100:00100000:2.0:1788839870.753990:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050241024 00000100:00100000:2.0:1788839870.754054:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1788839870.754066:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+7:15605:x1875734050241024:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839870.754089:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.754111:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657429f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d10 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839870.754217:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839870.754317:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657429f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d10 expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.754331:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.754334:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839870.754339:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657429f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d10 expref: 9 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.754353:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7200, rc 0) 00000100:00100000:2.0:1788839870.754418:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+8:15605:x1875734050241024:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 355us (786us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788839870.754425:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1788839870.757225:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839870.757673:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050241280 00000100:00100000:0.0:1788839870.757692:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050241280 00000100:00100000:0.0:1788839870.757752:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788839870.757763:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+8:15605:x1875734050241280:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1788839870.758097:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839870.758123:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68200/0xad5b343a26574298 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d09 expref: 8 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.758140:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:0.0:1788839870.758144:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788839870.758164:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.758177:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.758186:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839870.758378:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000273acf2b reply state 00000000bfcae905 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.758462:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839870.758471:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:0.0:1788839870.758474:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788839870.758477:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788839870.758484:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788839870.759056:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5247e572-2edf-4a2d-83f4-3e72ae063b75+9:15605:x1875734050241280:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 1291us (1837us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788839870.759065:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1788839870.761401:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.761469:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050241536 00000100:00100000:2.0:1788839870.761479:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050241536 00000100:00100000:2.0:1788839870.761549:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1788839870.761559:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+9:15605:x1875734050241536:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839870.761830:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+10:15605:x1875734050241536:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 271us (447us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788839870.761856:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1788839870.765065:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.765153:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050241792 00000100:00100000:2.0:1788839870.765164:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050241792 00000100:00100000:2.0:1788839870.765229:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1788839870.765239:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+10:15605:x1875734050241792:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839870.765263:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.765284:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a265742b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d17 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.765359:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.765374:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.765384:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.765395:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.765402:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.765408:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839870.765507:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839870.765662:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766310:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766319:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766324:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839870.766328:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766335:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766350:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.766353:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.766357:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766363:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a265742bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766377:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766383:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766389:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766394:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839870.766407:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766413:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766422:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab7750d2f00) 00010000:00010000:2.0:1788839870.766425:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.766428:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766433:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a265742c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766474:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a265742b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d17 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766484:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839870.766486:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839870.766490:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a265742b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d17 expref: 12 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.766498:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7000, rc 0) 00000100:00100000:2.0:1788839870.766580:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+11:15605:x1875734050241792:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1341us (1524us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788839870.766588:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1788839870.770699:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.771003:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050241920 00000100:00100000:2.0:1788839870.771013:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050241920 00000100:00100000:2.0:1788839870.771076:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1788839870.771086:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+11:15605:x1875734050241920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839870.771123:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.771143:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a265742d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d1e expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.771228:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.771243:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.771254:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839870.771277:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788839870.771280:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839870.771298:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.771323:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a265742d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 13 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.771340:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.771348:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:2.0:1788839870.771351:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788839870.771354:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6e00, rc 0) 00000100:00100000:2.0:1788839870.771401:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+12:15605:x1875734050241920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 317us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.771407:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1788839870.775424:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.775934:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050242048 00000100:00100000:2.0:1788839870.775944:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050242048 00000100:00100000:2.0:1788839870.776048:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788839870.776058:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+12:15605:x1875734050242048:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:2.0:1788839870.782114:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+12:15605:x1875734050242048:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 6046us (6686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.782128:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1788839870.785814:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839870.785946:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050242304 00000100:00100000:1.0:1788839870.785956:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050242304 00000100:00100000:1.0:1788839870.786012:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1788839870.786035:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7750cb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+12:15605:x1875734050242304:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1788839870.786256:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7750cb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+13:15605:x1875734050242304:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 223us (485us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788839870.786264:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1788839870.863026:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839870.863110:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050242432 00000100:00100000:3.0:1788839870.863135:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050242432 00000100:00100000:3.0:1788839870.863218:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1788839870.863228:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+11:15611:x1875734050242432:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839870.863248:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839870.863267:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265742de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d25 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863333:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863364:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863375:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863466:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863476:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863496:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863670:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552000/0xad5b343a265742f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863680:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552000/0xad5b343a265742f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863687:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552000/0xad5b343a265742f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839870.863720:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788839870.863724:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839870.863761:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552000/0xad5b343a265742f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.863797:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864345:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864352:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864359:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab782078c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839870.864363:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864371:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864468:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:3.0:1788839870.864472:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839870.864478:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864484:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265742e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864501:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864508:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864513:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864596:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839870.864600:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864607:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864616:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab7750d2f00) 00010000:00010000:3.0:1788839870.864618:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839870.864621:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864627:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265742ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864673:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265742de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d25 expref: 13 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864689:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552000/0xad5b343a265742f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d25 expref: 12 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.864696:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:3.0:1788839870.864698:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788839870.864701:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552000, rc 0) 00000100:00100000:3.0:1788839870.864938:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+12:15611:x1875734050242432:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1709us (1919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839870.864946:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1788839870.869197:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.869276:0:17125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050242560 00000100:00100000:2.0:1788839870.869286:0:17125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050242560 00000100:00100000:2.0:1788839870.869347:0:17125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788839870.869358:0:17125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb9a0095-2d97-404b-912c-8b552d60d900+5:15611:x1875734050242560:12345-192.168.203.52@tcp:900:bash.0 00000100:00100000:2.0:1788839870.869654:0:17125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb9a0095-2d97-404b-912c-8b552d60d900+5:15611:x1875734050242560:12345-192.168.203.52@tcp:900:bash.0 Request processed in 297us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.869663:0:17125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788839870.871594:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.871724:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050242816 00000100:00100000:2.0:1788839870.871732:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050242816 00000100:00100000:2.0:1788839870.871854:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1788839870.871865:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+12:15611:x1875734050242816:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839870.871885:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.871907:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a265742fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d2c expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.872010:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.872024:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.872048:0:17114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.872084:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 12 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.872099:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 12 pid: 17114 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839870.872114:0:17114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17114:1875734060806656:192.168.203.52@tcp:104: 00000100:00100000:2.0:1788839870.872201:0:17114:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab646a780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839870.878154:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839870.878248:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050242944 00000100:00100000:3.0:1788839870.878258:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050242944 00010000:00010000:3.0:1788839870.878298:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 13 pid: 17114 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839870.878343:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1788839870.878353:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+13:2390:x1875734050242944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839870.878368:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839870.878375:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 13 pid: 17114 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.878400:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 13 pid: 17114 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.878452:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:3.0:1788839870.878458:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.878468:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.878476:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839870.878495:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839870.878579:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5247e572-2edf-4a2d-83f4-3e72ae063b75+13:2390:x1875734050242944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 227us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839870.878587:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:2.0:1788839870.880308:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265742d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d1e expref: 12 pid: 17114 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839870.880330:0:17114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17114:1875734060806656:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839870.880352:0:17114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.880361:0:17114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.880368:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.880661:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.880676:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.880697:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881385:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881412:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881421:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839870.881613:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788839870.881659:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881668:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881675:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881681:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839870.881685:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881693:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881705:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:2.0:1788839870.881708:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839870.881720:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881727:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574301 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788839870.881739:0:17114:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a493919 reply state 000000007f00384a transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881750:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.881757:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab646802700) 00010000:00010000:2.0:1788839870.881759:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839870.881762:0:17114:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788839870.882055:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a265742fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 15 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.882072:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 14 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.882079:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839870.882082:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788839870.882084:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6200, rc 0) 00000100:00100000:2.0:1788839870.882242:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+15:15611:x1875734050242816:12345-192.168.203.52@tcp:101:bash.0 Request processed in 10379us (10655us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788839870.882251:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1788839870.905181:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.908969:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050243072 00000100:00100000:2.0:1788839870.908986:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050243072 00000100:00100000:2.0:1788839870.910247:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1788839870.910262:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+15:15611:x1875734050243072:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839870.910301:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839870.910323:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657431d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d33 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910391:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910405:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910416:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839870.910472:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788839870.910477:0:17113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839870.910495:0:17113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910506:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910551:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657431d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d33 expref: 17 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910570:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d33 expref: 16 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839870.910578:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839870.910581:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839870.910584:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7000, rc 0) 00000040:00080000:1.0:1788839870.911454:0:17865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788839870.913166:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+16:15611:x1875734050243072:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2901us (7988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839870.913178:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:0.0:1788839870.916800:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788839870.920036:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839870.920227:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050243328 00000100:00100000:2.0:1788839870.920244:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050243328 00000100:00100000:2.0:1788839870.920303:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1788839870.920313:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+16:15611:x1875734050243328:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1788839870.920618:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+17:15611:x1875734050243328:12345-192.168.203.52@tcp:35:bash.0 Request processed in 305us (590us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788839870.920626:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1788839871.032224:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.032341:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050243584 00000100:00100000:2.0:1788839871.032350:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050243584 00000100:00100000:2.0:1788839871.032419:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1788839871.032430:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+17:15621:x1875734050243584:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839871.032462:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839871.032483:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657432b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d3a expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839871.032590:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839871.032686:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657432b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d3a expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.032701:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839871.032704:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839871.032708:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a2657432b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d3a expref: 19 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.032740:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7200, rc 0) 00000100:00100000:2.0:1788839871.032832:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+18:15621:x1875734050243584:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 403us (617us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788839871.032840:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00080000:1.0:1788839871.033139:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788839871.038565:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.038943:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050243840 00000100:00100000:2.0:1788839871.038953:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050243840 00000100:00100000:2.0:1788839871.039000:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1788839871.039010:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+18:15621:x1875734050243840:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839871.039987:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+19:15621:x1875734050243840:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 974us (1428us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788839871.039996:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1788839871.090659:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.090761:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050244096 00000100:00100000:2.0:1788839871.090801:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050244096 00000100:00100000:2.0:1788839871.090861:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1788839871.090871:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+19:15624:x1875734050244096:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839871.090895:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839871.090915:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574339 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d41 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.091017:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574340 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.091032:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.091044:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574340 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839871.091069:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788839871.091628:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574339 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d41 expref: 22 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.091647:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574340 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d41 expref: 21 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.091657:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839871.091660:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839871.091664:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6e00, rc 0) 00000100:00100000:0.0:1788839871.091847:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+21:15624:x1875734050244096:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 899us (1119us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788839871.091856:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1788839871.096391:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839871.096446:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.096611:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050244224 00000100:00100000:2.0:1788839871.096622:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050244224 00000100:00100000:2.0:1788839871.096701:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1788839871.096711:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+21:15624:x1875734050244224:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1788839871.096810:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096829:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096840:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096875:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096882:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096889:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096895:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839871.096900:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096907:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096936:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839871.096939:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839871.096943:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.096949:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657434e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839871.097009:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+21:15624:x1875734050244224:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 300us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839871.097017:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1788839871.099136:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.099300:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050244608 00000100:00100000:2.0:1788839871.099310:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050244608 00000100:00100000:2.0:1788839871.099356:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1788839871.099366:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb9a0095-2d97-404b-912c-8b552d60d900+21:15624:x1875734050244608:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1788839871.099966:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050244352 00000100:00100000:0.0:1788839871.099973:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050244352 00000100:00100000:2.0:1788839871.100084:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb9a0095-2d97-404b-912c-8b552d60d900+23:15624:x1875734050244608:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 717us (953us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788839871.100094:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1788839871.100153:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1788839871.100162:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb9a0095-2d97-404b-912c-8b552d60d900+22:2390:x1875734050244352:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839871.100175:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839871.100200:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574340 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d41 expref: 22 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.100238:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839871.100243:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839871.100269:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb9a0095-2d97-404b-912c-8b552d60d900+21:2390:x1875734050244352:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 108us (3822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839871.100276:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000040:00080000:0.0:1788839871.359463:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788839871.532588:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839871.532730:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050244864 00000100:00100000:3.0:1788839871.532739:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050244864 00000100:00100000:3.0:1788839871.532834:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788839871.532846:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+21:15655:x1875734050244864:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1788839871.532870:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839871.532890:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574355 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d48 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839871.533000:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657435c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839871.533016:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657435c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839871.533027:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657435c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839871.533052:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788839871.533765:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574355 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d48 expref: 24 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839871.533815:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657435c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d48 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839871.533825:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:3.0:1788839871.533828:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839871.533832:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e553600, rc 0) 00000100:00100000:3.0:1788839871.533903:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+23:15655:x1875734050244864:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1059us (1323us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788839871.533911:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1788839871.544742:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839871.545168:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050244992 00000100:00100000:0.0:1788839871.545179:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050244992 00000100:00100000:0.0:1788839871.545249:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1788839871.545259:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+23:2389:x1875734050244992:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839871.545275:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839871.545300:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a2657435c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d48 expref: 23 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.545322:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839871.545327:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839871.545394:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+22:2389:x1875734050244992:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 137us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839871.545401:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1788839871.550650:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.551348:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050245248 00000100:00100000:2.0:1788839871.551357:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050245248 00000100:00100000:2.0:1788839871.551432:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1788839871.551442:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7486c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+22:15655:x1875734050245248:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:2.0:1788839871.551745:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7486c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+23:15655:x1875734050245248:12345-192.168.203.52@tcp:35:cat.0 Request processed in 304us (1114us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788839871.551754:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1788839871.686228:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.686544:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050245504 00000100:00100000:2.0:1788839871.686568:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050245504 00000100:00100000:2.0:1788839871.686642:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1788839871.686654:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+23:15661:x1875734050245504:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1788839871.686679:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839871.686701:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657436a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d4f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.687031:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26574371 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.687047:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26574371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.687059:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26574371 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839871.687071:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788839871.687212:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a2657436a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d4f expref: 26 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.687231:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26574371 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d4f expref: 25 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.687240:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839871.687244:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788839871.687247:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7800, rc 0) 00000100:00100000:2.0:1788839871.687372:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+25:15661:x1875734050245504:12345-192.168.203.52@tcp:101:dd.0 Request processed in 720us (1152us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788839871.688871:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1788839871.721000:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839871.721077:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050245632 00000100:00100000:0.0:1788839871.721088:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050245632 00000100:00100000:0.0:1788839871.721170:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1788839871.721182:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:2389:x1875734050245632:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839871.721198:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839871.721222:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a26574371 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d4f expref: 25 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.721254:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839871.721259:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839871.721318:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb9a0095-2d97-404b-912c-8b552d60d900+24:2389:x1875734050245632:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 138us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839871.721326:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1788839871.724369:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839871.724521:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050245760 00000100:00100000:0.0:1788839871.724544:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050245760 00000100:00100000:0.0:1788839871.724601:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1788839871.724611:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+24:15661:x1875734050245760:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1788839871.724644:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839871.724664:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657437f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d56 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.724702:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.724715:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.724727:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.724877:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a2657437f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 26 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.724896:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 25 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839871.724917:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839871.724920:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788839871.724924:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68a00, rc 0) 00000100:00100000:0.0:1788839871.725005:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:15661:x1875734050245760:12345-192.168.203.52@tcp:101:dd.0 Request processed in 396us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839871.725013:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1788839871.733490:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.733813:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050246016 00000100:00100000:2.0:1788839871.733823:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050246016 00000100:00100000:2.0:1788839871.733885:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1788839871.733895:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+25:15661:x1875734050246016:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:2.0:1788839871.733950:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839871.733977:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7000/0xad5b343a26574324 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d33 expref: 25 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.733996:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839871.734002:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839871.734183:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.734198:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.734209:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839871.734280:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788839871.734317:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d0dc4be reply state 000000009095f3ed transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.734330:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839871.734337:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839871.734339:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839871.734342:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839871.734968:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+27:15661:x1875734050246016:12345-192.168.203.52@tcp:36:dd.0 Request processed in 1071us (1483us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788839871.734987:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000020:00080000:2.0:1788839871.734993:0:17149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788839871.924880:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839871.925036:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050246272 00000100:00100000:2.0:1788839871.925046:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050246272 00000100:00100000:2.0:1788839871.925110:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1788839871.925121:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab647bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+27:15661:x1875734050246272:12345-192.168.203.52@tcp:35:dd.0 00000100:00100000:2.0:1788839871.925376:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab647bb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+28:15661:x1875734050246272:12345-192.168.203.52@tcp:35:dd.0 Request processed in 256us (504us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788839871.925393:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:2.0:1788839871.936461:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839872.370195:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839872.370295:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050246400 00000100:00100000:0.0:1788839872.370304:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050246400 00000100:00100000:0.0:1788839872.370367:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1788839872.370379:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+28:15675:x1875734050246400:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1788839872.370402:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839872.370423:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a26574394 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d5d expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370492:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370526:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370541:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370554:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370561:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370585:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370659:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370668:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370675:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839872.370714:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788839872.370719:0:17113:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788839872.370756:0:17113:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370954:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370965:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370971:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370979:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.370984:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839872.370988:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371001:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371013:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:0.0:1788839872.371016:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839872.371020:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371026:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a2657439b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371039:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371045:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371050:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371055:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839872.371058:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371064:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371070:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab646802700) 00010000:00010000:0.0:1788839872.371073:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839872.371076:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371090:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265743a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371116:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a26574394 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d5d expref: 30 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371128:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d5d expref: 29 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.371135:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839872.371138:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788839872.371140:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68800, rc 0) 00000100:00100000:0.0:1788839872.371243:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+29:15675:x1875734050246400:12345-192.168.203.52@tcp:101:stat.0 Request processed in 865us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839872.371251:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1788839872.495084:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.495330:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050246656 00000100:00100000:2.0:1788839872.495341:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050246656 00000100:00100000:2.0:1788839872.495409:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1788839872.495420:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+29:15681:x1875734050246656:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:2.0:1788839872.495551:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839872.495590:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a265743a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d5d expref: 29 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.496180:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839872.496186:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839872.496406:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.496421:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.496431:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839872.497113:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788839872.497143:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b2dc36d reply state 000000006b62d343 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.497158:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.497165:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839872.497168:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839872.497171:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839872.497378:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+31:15681:x1875734050246656:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 1957us (2301us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788839872.497387:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000020:00080000:2.0:1788839872.497393:0:17149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788839872.704585:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839872.705165:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050246784 00000100:00100000:3.0:1788839872.705176:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050246784 00000100:00100000:3.0:1788839872.705246:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1788839872.705257:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+31:15695:x1875734050246784:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:3.0:1788839872.705446:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839872.705467:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265743b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d64 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705576:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705701:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705714:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705727:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705734:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705740:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705854:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705864:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.705871:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839872.706072:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788839872.706076:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839872.706098:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706120:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706128:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706134:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706140:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706146:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e552800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839872.706150:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706157:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706169:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:3.0:1788839872.706172:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839872.706176:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706182:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a265743be lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706197:0:17115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706204:0:17115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706215:0:17115:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706221:0:17115:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839872.706712:0:17115:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706720:0:17115:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706730:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab646802700) 00010000:00010000:3.0:1788839872.706732:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788839872.706735:0:17115:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706741:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a265743c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706829:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a265743b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 33 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706845:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 32 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.706852:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:3.0:1788839872.706854:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839872.706856:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782079400, rc 0) 00000100:00100000:3.0:1788839872.707455:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+32:15695:x1875734050246784:12345-192.168.203.52@tcp:101:stat.0 Request processed in 2195us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839872.707477:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1788839872.815514:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.815706:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050247040 00000100:00100000:2.0:1788839872.815716:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050247040 00000100:00100000:2.0:1788839872.815810:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1788839872.815820:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+32:15705:x1875734050247040:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839872.815841:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839872.815861:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265743d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d6b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839872.815968:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839872.816058:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265743d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d6b expref: 34 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.816074:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839872.816077:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839872.816094:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265743d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d6b expref: 34 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.816108:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6600, rc 0) 00000100:00100000:2.0:1788839872.816168:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+33:15705:x1875734050247040:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 349us (671us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788839872.816177:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1788839872.823602:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.823721:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050247296 00000100:00100000:2.0:1788839872.823732:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050247296 00000100:00100000:2.0:1788839872.823817:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788839872.823829:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7750c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+33:15705:x1875734050247296:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839872.824052:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7750c8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+34:15705:x1875734050247296:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 224us (615us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788839872.824060:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1788839872.895547:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060806784:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788839872.895629:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839872.895821:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060806784 00000100:00100000:3.0:1788839872.895829:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060806784 00000100:00100000:3.0:1788839872.895901:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788839872.895912:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060806784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788839872.895940:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788839872.896009:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060806784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839872.896016:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788839872.896233:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060806784:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788839872.896375:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839872.928440:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839872.928542:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050247552 00000100:00100000:0.0:1788839872.928552:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050247552 00000100:00100000:0.0:1788839872.928627:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788839872.928638:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+34:15711:x1875734050247552:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839872.928662:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839872.928685:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265743e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d72 expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.928912:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.928928:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.928937:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 35 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.928946:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.928981:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 35 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.928995:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 35 pid: 17115 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839872.929009:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060806912:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839872.929117:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.929128:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839872.929140:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060807040:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839872.929182:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e557f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788839872.933717:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e42300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060806912:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839872.942731:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.942837:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050247680 00000100:00100000:2.0:1788839872.942847:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050247680 00010000:00010000:2.0:1788839872.942891:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 36 pid: 17115 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839872.942935:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1788839872.942945:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb9a0095-2d97-404b-912c-8b552d60d900+36:2389:x1875734050247680:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839872.942961:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839872.942969:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 36 pid: 17115 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.943014:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 36 pid: 17115 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839872.943027:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777e40380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060807040:192.168.203.52@tcp:104: 00010000:00010000:2.0:1788839872.943037:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a265743cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d64 expref: 36 pid: 17115 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.943059:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839872.943060:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.943065:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.943075:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.943082:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839872.943130:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb9a0095-2d97-404b-912c-8b552d60d900+35:2389:x1875734050247680:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 187us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839872.943137:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1788839872.943895:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839872.944096:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050247808 00000100:00100000:1.0:1788839872.944104:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050247808 00010000:00010000:1.0:1788839872.944129:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839872.944165:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1788839872.944174:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+35:2391:x1875734050247808:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788839872.944186:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839872.944201:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839872.944213:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839872.944231:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657430f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d2c expref: 35 pid: 17114 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839872.944243:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:1.0:1788839872.944247:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839872.944256:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839872.944264:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839872.944294:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788839872.944332:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+34:2391:x1875734050247808:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 160us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839872.944339:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00010000:00010000:0.0:1788839872.944393:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.944403:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788839872.944423:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788839872.944557:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265743e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 35 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.944573:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 34 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839872.944582:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839872.944585:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788839872.944588:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e69800, rc 0) 00000100:00100000:0.0:1788839872.945435:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+34:15711:x1875734050247552:12345-192.168.203.52@tcp:101:bash.0 Request processed in 16795us (17000us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788839872.945444:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1788839872.949949:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.950082:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248064 00000100:00100000:2.0:1788839872.950092:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248064 00000100:00100000:2.0:1788839872.950154:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1788839872.950164:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+34:15711:x1875734050248064:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1788839872.950401:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.950419:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.950431:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788839872.950490:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788839872.950512:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a702a1ac reply state 0000000035e7daca transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.950537:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.950545:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839872.950548:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788839872.950552:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788839872.950647:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+37:15711:x1875734050248064:12345-192.168.203.52@tcp:36:bash.0 Request processed in 484us (708us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788839872.950655:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000020:00080000:2.0:1788839872.950660:0:17149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788839872.952648:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839872.952812:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248192 00000100:00100000:3.0:1788839872.952822:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248192 00000100:00100000:3.0:1788839872.952872:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1788839872.952891:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+37:15711:x1875734050248192:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839872.952918:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839872.952939:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265743fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d79 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.952994:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265743fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d79 expref: 38 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.953007:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265743fd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d79 expref: 38 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.953024:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:3.0:1788839872.953027:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788839872.953030:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab782078c00, rc 0) 00000100:00100000:3.0:1788839872.953166:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+38:15711:x1875734050248192:12345-192.168.203.52@tcp:101:bash.0 Request processed in 284us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839872.953174:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00010000:00010000:3.0:1788839872.965103:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839872.977115:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839872.977222:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248320 00000100:00100000:3.0:1788839872.977231:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248320 00000100:00100000:3.0:1788839872.977297:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:3.0:1788839872.977317:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+38:15711:x1875734050248320:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1788839872.977338:0:17114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839872.977360:0:17114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a26574404 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d80 expref: -99 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.977450:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.977466:0:17114:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 39 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.977475:0:17114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.977529:0:17114:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 39 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.977543:0:17114:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 39 pid: 17113 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839872.977556:0:17114:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17114:1875734060807168:192.168.203.52@tcp:104: 00000100:00100000:3.0:1788839872.977671:0:17114:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760dba180 going to sleep for 11 seconds 00000100:00100000:1.0:1788839872.982185:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.982278:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248448 00000100:00100000:2.0:1788839872.982303:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248448 00010000:00010000:2.0:1788839872.982351:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 40 pid: 17113 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839872.982394:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1788839872.982405:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+40:2390:x1875734050248448:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839872.982421:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839872.982428:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 40 pid: 17113 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.982442:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 40 pid: 17113 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.982485:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839872.982491:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.983045:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.983057:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.983079:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839872.983138:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+40:2390:x1875734050248448:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 734us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839872.983146:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:3.0:1788839872.984299:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69800/0xad5b343a265743e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d72 expref: 39 pid: 17113 timeout: 627 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839872.984320:0:17114:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17114:1875734060807168:192.168.203.52@tcp:104: 00010000:00010000:3.0:1788839872.984341:0:17114:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.984350:0:17114:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.984355:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788839872.984406:0:17114:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788839872.984411:0:17114:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788839872.984430:0:17114:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.984463:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782079400/0xad5b343a26574404 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d80 expref: 39 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.984479:0:17114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d80 expref: 38 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.984487:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:3.0:1788839872.984489:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839872.984492:0:17114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552e00, rc 0) 00000100:00100000:3.0:1788839872.984563:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+38:15711:x1875734050248320:12345-192.168.203.52@tcp:101:bash.0 Request processed in 7248us (7888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839872.984584:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1788839872.991528:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839872.992030:0:17098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248704 00000100:00100000:2.0:1788839872.992039:0:17098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248704 00000100:00100000:2.0:1788839872.992114:0:17098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1788839872.992125:0:17098:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb9a0095-2d97-404b-912c-8b552d60d900+38:15711:x1875734050248704:12345-192.168.203.52@tcp:103:bash.0 00010000:00010000:2.0:1788839872.992141:0:17098:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788839872.992166:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab782078c00/0xad5b343a265743fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d79 expref: 38 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.992191:0:17098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a2657440b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d80 expref: 37 pid: 17114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839872.992202:0:17098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839872.992208:0:17098:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839872.992275:0:17098:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb9a0095-2d97-404b-912c-8b552d60d900+36:15711:x1875734050248704:12345-192.168.203.52@tcp:103:bash.0 Request processed in 153us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839872.992284:0:17098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1788839872.997952:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839872.998310:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248832 00000100:00100000:3.0:1788839872.998320:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248832 00000100:00100000:3.0:1788839872.998379:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1788839872.998389:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+36:15711:x1875734050248832:12345-192.168.203.52@tcp:58:bash.0 00010000:00010000:3.0:1788839872.998522:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.998539:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839872.998549:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788839873.002114:0:17115:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788839873.002437:0:17115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788839873.003053:0:17115:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788839873.003285:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+36:15711:x1875734050248832:12345-192.168.203.52@tcp:58:bash.0 Request processed in 4893us (5336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839873.003295:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1788839873.007099:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.007262:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050248960 00000100:00100000:2.0:1788839873.007273:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050248960 00000100:00100000:2.0:1788839873.007392:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1788839873.007402:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+36:15711:x1875734050248960:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1788839873.007423:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839873.007445:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d87 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.007524:0:17149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.007536:0:17149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 37 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.007556:0:17149:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.007569:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 37 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.007582:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839873.007585:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839873.007589:0:17149:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 37 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.007597:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6400, rc 0) 00000100:00100000:2.0:1788839873.007685:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+37:15711:x1875734050248960:12345-192.168.203.52@tcp:101:bash.0 Request processed in 276us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.007692:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00080000:1.0:1788839873.009399:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788839873.408255:0:17150:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788839873.408265:0:17150:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839873.408290:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788839873.408298:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788839873.408442:0:17150:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17150:1875734060807296:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788839873.408557:0:17150:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760dbad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788839873.411180:0:17150:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17150:1875734060807296:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788839873.413983:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.414271:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050249088 00000100:00100000:1.0:1788839873.414280:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050249088 00000100:00100000:1.0:1788839873.414356:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1788839873.414365:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+37:15712:x1875734050249088:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788839873.414401:0:17113:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788839873.414535:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+37:15712:x1875734050249088:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 170us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839873.414544:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1788839873.420347:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.420652:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050249216 00000100:00100000:2.0:1788839873.420662:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050249216 00000100:00100000:2.0:1788839873.420719:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1788839873.420728:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+37:15712:x1875734050249216:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788839873.420818:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420835:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420849:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420904:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420912:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420919:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420940:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420949:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.420956:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839873.421017:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788839873.421021:0:17149:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839873.421036:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421048:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421055:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421063:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421069:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.421074:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421081:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421093:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab647853d00) 00010000:00010000:2.0:1788839873.421096:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839873.421100:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421106:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574420 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421131:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421146:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421152:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421157:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.421160:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421166:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421173:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ab646802400) 00010000:00010000:2.0:1788839873.421176:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839873.421179:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421185:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574427 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421197:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421201:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421208:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421212:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.421219:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421225:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421232:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839873.421234:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839873.421236:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.421242:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657442e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.421314:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+37:15712:x1875734050249216:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 586us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.421322:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1788839873.423803:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.423897:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050249472 00000100:00100000:1.0:1788839873.423906:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050249472 00000100:00100000:1.0:1788839873.424005:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1788839873.424016:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+37:15712:x1875734050249472:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839873.424038:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839873.424068:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574435 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d8e expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424161:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424186:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424198:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788839873.424209:0:17113:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788839873.424284:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424291:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424316:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424323:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958000 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.424328:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424335:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424347:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:1.0:1788839873.424350:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788839873.424354:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424361:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a2657443c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424402:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574435 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d8e expref: 39 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424412:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab647853d00) 00010000:00010000:1.0:1788839873.424414:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788839873.424418:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a26574435 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d8e expref: 39 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.424428:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647959e00, rc 0) 00000100:00100000:1.0:1788839873.424488:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+38:15712:x1875734050249472:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 474us (718us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788839873.424504:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1788839873.430830:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.431812:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050249600 00000100:00100000:2.0:1788839873.431824:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050249600 00000100:00100000:2.0:1788839873.431891:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1788839873.431901:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+38:15712:x1875734050249600:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788839873.431938:0:17149:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788839873.432063:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+38:15712:x1875734050249600:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 163us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.432071:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1788839873.443719:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1788839873.443939:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050249856 00000100:00100000:3.0:1788839873.443962:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050249856 00000100:00100000:3.0:1788839873.444025:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788839873.444035:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+38:15712:x1875734050249856:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788839873.444055:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788839873.444075:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657444a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d95 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788839873.444436:0:17115:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:3.0:1788839873.444443:0:17115:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788839873.444461:0:17115:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788839873.444620:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574451 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.444645:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574451 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.444656:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574451 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.444708:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552800/0xad5b343a2657444a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d95 expref: 41 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.444727:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574451 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d95 expref: 40 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.444736:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab747cc7400) 00010000:00010000:3.0:1788839873.444738:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788839873.444742:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab75e552e00, rc 0) 00000100:00100000:3.0:1788839873.445707:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+40:15712:x1875734050249856:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1667us (1991us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788839873.445735:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1788839873.448924:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.449063:0:17114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050250112 00000100:00100000:2.0:1788839873.449074:0:17114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050250112 00000100:00100000:2.0:1788839873.449321:0:17114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1788839873.449332:0:17114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+40:15712:x1875734050250112:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788839873.449412:0:17114:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839873.449443:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e552e00/0xad5b343a26574451 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d95 expref: 40 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449464:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab747cc7400) 00010000:00010000:2.0:1788839873.449475:0:17114:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788839873.449496:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449510:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449534:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449548:0:17114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449555:0:17114:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449561:0:17114:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449601:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449609:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449616:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449628:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.449633:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449641:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449651:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:2.0:1788839873.449654:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839873.449657:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449663:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a2657445f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449673:0:17114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449679:0:17114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449685:0:17114:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449690:0:17114:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.449693:0:17114:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449700:0:17114:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449883:0:17114:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6908f8ac (ffff8ab646802400) 00010000:00010000:2.0:1788839873.449886:0:17114:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839873.449889:0:17114:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.449895:0:17114:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574466 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6908f8ac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.450051:0:17114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb9a0095-2d97-404b-912c-8b552d60d900+39:15712:x1875734050250112:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 718us (1132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788839873.450060:0:17114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1788839873.451857:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.451953:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050250240 00000100:00100000:1.0:1788839873.451963:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050250240 00000100:00100000:1.0:1788839873.452017:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788839873.452028:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+39:15712:x1875734050250240:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788839873.452049:0:17113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839873.452069:0:17113:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657446d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74d9c expref: -99 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.452102:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574474 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.452113:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.452123:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574474 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.452225:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a2657446d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d9c expref: 41 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.452243:0:17113:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958000/0xad5b343a26574474 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d9c expref: 40 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.452252:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:1.0:1788839873.452254:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839873.452258:0:17113:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958000, rc 0) 00000100:00100000:1.0:1788839873.452411:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+40:15712:x1875734050250240:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 385us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839873.452426:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1788839873.455546:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.455821:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050250496 00000100:00100000:1.0:1788839873.455830:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050250496 00000100:00100000:1.0:1788839873.455882:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788839873.455898:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+40:15712:x1875734050250496:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839873.456012:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.456029:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.456041:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788839873.456230:0:17149:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788839873.456240:0:17149:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 528400469406ns, next at 529400466978ns, rc = 0 00000004:00010000:1.0:1788839873.456291:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001562f143 reply state 00000000ecbf0ff1 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.456305:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.456313:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:1.0:1788839873.456317:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788839873.456320:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839873.456659:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+42:15712:x1875734050250496:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 759us (1119us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788839873.456667:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1788839873.458853:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.458883:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050250624 00000100:00100000:2.0:1788839873.458893:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050250624 00000100:00100000:2.0:1788839873.458944:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1788839873.458954:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+42:15712:x1875734050250624:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839873.458978:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839873.458998:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74da3 expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.459056:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 43 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.459070:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 43 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.459089:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:2.0:1788839873.459092:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839873.459108:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7200, rc 0) 00000100:00100000:2.0:1788839873.459168:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+43:15712:x1875734050250624:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 215us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.459176:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1788839873.463151:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.463396:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050250752 00000100:00100000:2.0:1788839873.463406:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050250752 00000100:00100000:2.0:1788839873.463471:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788839873.463480:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+5:2391:x1875734050250752:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788839873.463737:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777e42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+6:2391:x1875734050250752:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 257us (599us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788839873.463746:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00080000:1.0:1788839873.463893:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788839873.472951:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.473669:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050251008 00000100:00100000:2.0:1788839873.473681:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050251008 00000100:00100000:2.0:1788839873.473743:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788839873.473753:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+43:15712:x1875734050251008:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788839873.474018:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+44:15712:x1875734050251008:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 266us (1077us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788839873.474026:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1788839873.480188:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.481320:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050251264 00000100:00100000:1.0:1788839873.481332:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050251264 00000100:00100000:1.0:1788839873.481405:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788839873.481416:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+44:15712:x1875734050251264:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839873.481555:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+44:15712:x1875734050251264:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 140us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839873.481562:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1788839873.485529:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.485736:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050251392 00000100:00100000:2.0:1788839873.485747:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050251392 00000100:00100000:2.0:1788839873.485835:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1788839873.485845:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+44:15712:x1875734050251392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839873.485867:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839873.485889:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574489 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74daa expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.485989:0:17115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a26574490 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.486005:0:17115:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a26574490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.486016:0:17115:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a26574490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839873.486060:0:17115:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788839873.486079:0:17115:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a26574490 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.486104:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a26574489 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74daa expref: 46 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.486122:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a26574490 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74daa expref: 45 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.486130:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:2.0:1788839873.486133:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788839873.486137:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6200, rc 0) 00000100:00100000:2.0:1788839873.486203:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+45:15712:x1875734050251392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 359us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.486210:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1788839873.489470:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.489557:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050251520 00000100:00100000:2.0:1788839873.489568:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050251520 00000100:00100000:2.0:1788839873.489628:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1788839873.489653:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+6:2389:x1875734050251520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788839873.489673:0:19203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839873.489694:0:19203:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74db1 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788839873.489720:0:19203:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f87c0, blocks: 0x0 00010000:00010000:2.0:1788839873.489739:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788839873.489744:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839873.489754:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 7 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.489807:0:19203:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 7 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.489822:0:19203:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de7000, rc 0) 00000100:00100000:2.0:1788839873.489872:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+7:2389:x1875734050251520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 222us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.489879:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788839873.506680:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.506851:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050251776 00000100:00100000:1.0:1788839873.506862:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050251776 00000100:00100000:1.0:1788839873.506921:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1788839873.506932:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+45:15712:x1875734050251776:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788839873.507054:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+45:15712:x1875734050251776:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 124us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839873.507061:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1788839873.511175:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.511256:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050251904 00000100:00100000:2.0:1788839873.511264:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050251904 00000100:00100000:2.0:1788839873.511318:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1788839873.511328:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+45:15712:x1875734050251904:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788839873.515361:0:17093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788839873.515380:0:17093:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788839873.515454:0:17093:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788839873.515794:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060807424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788839873.515865:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839873.515920:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060807424 00000100:00100000:0.0:1788839873.515927:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060807424 00000100:00100000:0.0:1788839873.515992:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788839873.516001:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060807424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788839873.516130:0:18620:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788839873.516133:0:18620:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788839873.516135:0:18620:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788839873.516137:0:18620:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788839872 -> 1788839872 00002000:00010000:0.0:1788839873.516139:0:18620:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788839873.516176:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875734060807424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (311us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788839873.516183:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788839873.516203:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788839873.516237:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab641aeed80/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788839873.516242:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060807424:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788839873.516480:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+20:15712:x1875734050251904:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 5151us (5310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.516697:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:3.0:1788839873.516819:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.516831:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.516840:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.516845:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:3.0:1788839873.516850:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.516857:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.516874:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:3.0:1788839873.516877:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788839873.516882:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.516888:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69200/0xad5b343a265742ad lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518759:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518798:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518806:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518812:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647959600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.518816:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518840:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518856:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab7750d2f00) 00010000:00010000:1.0:1788839873.518859:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839873.518863:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518869:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959600/0xad5b343a26574259 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518892:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518899:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518904:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518910:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.518912:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518919:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518929:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:1.0:1788839873.518932:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839873.518935:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518947:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7e00/0xad5b343a26574260 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518962:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518968:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518973:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518989:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.518992:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.518999:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519007:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab646802700) 00010000:00010000:1.0:1788839873.519010:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839873.519013:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519018:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7600/0xad5b343a26574308 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17114 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519033:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519038:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519050:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519055:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.519058:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519064:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519072:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:1.0:1788839873.519075:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839873.519077:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519083:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6800/0xad5b343a2657438d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519095:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519101:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519106:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519110:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7400 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.519113:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519129:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519138:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:1.0:1788839873.519140:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839873.519143:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519149:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7400/0xad5b343a265743b0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519160:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519167:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519173:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519178:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de7800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.519181:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519188:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519195:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:1.0:1788839873.519197:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788839873.519200:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519218:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7800/0xad5b343a265743f6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519232:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519238:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519243:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519248:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:1.0:1788839873.519251:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519258:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519266:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:1.0:1788839873.519269:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788839873.519272:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.519277:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657447b lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839873.523342:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.523633:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252032 00000100:00100000:2.0:1788839873.523643:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252032 00000100:00100000:2.0:1788839873.523707:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1788839873.523719:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab75e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+7:2390:x1875734050252032:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788839873.523851:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab75e93e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb9a0095-2d97-404b-912c-8b552d60d900+7:2390:x1875734050252032:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 134us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.523859:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839873.539636:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.539762:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252288 00000100:00100000:1.0:1788839873.539809:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252288 00000100:00100000:1.0:1788839873.539872:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788839873.539883:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+14:15712:x1875734050252288:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788839873.539949:0:17149:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788839873.539989:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6200/0xad5b343a26574490 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74daa expref: 14 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.540008:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:1.0:1788839873.540013:0:17149:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788839873.540045:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.540058:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.540068:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788839873.540187:0:17149:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8540de6 reply state 00000000e8649333 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.540200:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958e00/0xad5b343a2657449e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.540206:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:1.0:1788839873.540209:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788839873.540212:0:17149:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788839873.540297:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+15:15712:x1875734050252288:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 415us (671us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788839873.540304:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1788839873.545868:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.546079:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252416 00000100:00100000:0.0:1788839873.546088:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252416 00000100:00100000:0.0:1788839873.546152:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1788839873.546161:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb9a0095-2d97-404b-912c-8b552d60d900+7:15712:x1875734050252416:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788839873.546179:0:19600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839873.546199:0:19600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74db8 expref: -99 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.546230:0:19600:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.546240:0:19600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839873.546244:0:19600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839873.546249:0:19600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 8 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.546284:0:19600:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.546298:0:19600:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839873.546312:0:19600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19600:1875734060807552:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839873.546392:0:19600:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839873.550279:0:19600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aefb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19600:1875734060807552:192.168.203.52@tcp:104: 00010000:00010000:1.0:1788839873.550334:0:19600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 8 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.550355:0:19600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e68400, rc 0) 00000100:00100000:1.0:1788839873.550413:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb9a0095-2d97-404b-912c-8b552d60d900+8:15712:x1875734050252416:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4253us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839873.550421:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1788839873.558888:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.562509:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252544 00000100:00100000:2.0:1788839873.562532:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252544 00010000:00010000:2.0:1788839873.562587:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.562657:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1788839873.562668:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+8:2389:x1875734050252544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839873.562689:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839873.562713:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.562727:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.562748:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf09d0fc/0xad5b343a26574497 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db1 expref: 8 pid: 19203 timeout: 628 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.562828:0:17099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839873.562833:0:17099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788839873.562840:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 7 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.562851:0:17099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 7 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.562890:0:17099:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 7 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.562907:0:17099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17099:1875734060807680:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788839873.562991:0:17099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788839873.570758:0:17099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17099:1875734060807680:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788839873.570823:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839873.570886:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+7:2389:x1875734050252544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 8219us (12006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.570899:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1788839873.587432:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.587568:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252672 00000100:00100000:0.0:1788839873.587578:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252672 00000100:00100000:0.0:1788839873.587664:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1788839873.587675:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+7:2389:x1875734050252672:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788839873.587875:0:18622:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788839873.587880:0:18622:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788839872 00002000:00010000:0.0:1788839873.587882:0:18622:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788839870 00002000:00010000:0.0:1788839873.587884:0:18622:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788839872 -> 1788839872 00002000:00010000:0.0:1788839873.587887:0:18622:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788839873.587953:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+8:2389:x1875734050252672:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 279us (530us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788839873.587962:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1788839873.592717:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.594868:0:19203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252800 00000100:00100000:0.0:1788839873.594884:0:19203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252800 00000100:00100000:0.0:1788839873.594959:0:19203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1788839873.594970:0:19203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+8:2390:x1875734050252800:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788839873.595018:0:19203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.595041:0:19203:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 8 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.595050:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839873.595055:0:19203:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788839873.595060:0:19203:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.595099:0:19203:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 8 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.595131:0:19203:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 8 pid: 19600 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839873.595148:0:19203:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19203:1875734060807808:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839873.595255:0:19203:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5579c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788839873.600810:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.601013:0:19203:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19203:1875734060807808:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839873.601041:0:19203:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839873.601259:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050252928 00000100:00100000:3.0:1788839873.601268:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050252928 00010000:00010000:3.0:1788839873.601322:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 9 pid: 19600 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839873.601364:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1788839873.601379:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb9a0095-2d97-404b-912c-8b552d60d900+9:2389:x1875734050252928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788839873.601535:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788839873.601565:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 9 pid: 19600 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.601579:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 9 pid: 19600 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.601602:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b16192fe/0xad5b343a265744a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74db8 expref: 9 pid: 19600 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.601623:0:17100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839873.601636:0:17100:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788839873.601642:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.601653:0:17100:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788839873.601733:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788839873.601840:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb9a0095-2d97-404b-912c-8b552d60d900+8:2389:x1875734050252928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 465us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839873.601849:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00010000:00010000:2.0:1788839873.624807:0:19203:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624829:0:19203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624886:0:19203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624895:0:19203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624903:0:19203:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624910:0:19203:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69200 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:2.0:1788839873.624914:0:19203:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624923:0:19203:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624943:0:19203:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.624951:0:19203:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001aebc745/0xad5b343a265744ac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.625067:0:19203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb9a0095-2d97-404b-912c-8b552d60d900+7:2390:x1875734050252800:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 30093us (32354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.625087:0:19203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1788839873.630807:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.630886:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050253184 00000100:00100000:0.0:1788839873.630895:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050253184 00000100:00100000:0.0:1788839873.630965:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1788839873.630976:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+15:15712:x1875734050253184:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788839873.631068:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.631086:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 15 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.631095:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.631129:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 15 pid: 17113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.631164:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 15 pid: 17113 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839873.631180:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060807936:192.168.203.52@tcp:104: 00000100:00100000:0.0:1788839873.631280:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab75e5579c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788839873.634252:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aef800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060807936:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839873.634281:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839873.634874:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.634955:0:17099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050253312 00000100:00100000:2.0:1788839873.634964:0:17099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050253312 00010000:00010000:2.0:1788839873.635016:0:17099:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 16 pid: 17113 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.635043:0:17099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1788839873.635052:0:17099:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+16:2390:x1875734050253312:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788839873.635067:0:17099:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788839873.635072:0:17099:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 16 pid: 17113 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635095:0:17099:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 16 pid: 17113 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635119:0:17099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68a00/0xad5b343a26574386 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d56 expref: 16 pid: 17113 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635135:0:17099:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839873.635140:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 15 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635150:0:17099:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635158:0:17099:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635181:0:17099:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.635210:0:17099:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788839873.635273:0:17099:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb9a0095-2d97-404b-912c-8b552d60d900+15:2390:x1875734050253312:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 220us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.635281:0:17099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:1.0:1788839873.635453:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.635462:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.635687:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.635700:0:17113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 15 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.635708:0:17113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.635737:0:17113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 15 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.635762:0:17113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 15 pid: 17115 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788839873.635813:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060808064:192.168.203.52@tcp:104: 00000100:00100000:1.0:1788839873.635874:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744455e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788839873.641891:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060808064:192.168.203.52@tcp:104: 00010000:00010000:0.0:1788839873.641926:0:17113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788839873.649043:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.649635:0:17100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050253440 00000100:00100000:0.0:1788839873.649647:0:17100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050253440 00010000:00010000:0.0:1788839873.649702:0:17100:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 16 pid: 17115 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839873.649744:0:17100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1788839873.649754:0:17100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab760d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb9a0095-2d97-404b-912c-8b552d60d900+16:2389:x1875734050253440:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788839873.649811:0:17100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788839873.649819:0:17100:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 16 pid: 17115 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.649834:0:17100:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 16 pid: 17115 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.649870:0:17100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de7200/0xad5b343a26574482 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74da3 expref: 16 pid: 17115 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.649887:0:17100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:0.0:1788839873.649892:0:17100:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.649903:0:17100:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.649910:0:17100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.649932:0:17100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788839873.649988:0:17100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab760d08450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb9a0095-2d97-404b-912c-8b552d60d900+15:2389:x1875734050253440:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 234us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839873.650007:0:17100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:1.0:1788839873.650477:0:17113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.650487:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788839873.650621:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788839873.650757:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788839873.650843:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788839873.650921:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17113:1875734060808192:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839873.650987:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839873.651420:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744455a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788839873.651763:0:18138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060808192 00000100:00100000:0.0:1788839873.651791:0:18138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060808192 00000100:00100000:0.0:1788839873.651832:0:18138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788839873.651840:0:18138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17113:x1875734060808192:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839873.651928:0:18138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17113:x1875734060808192:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839873.651936:0:18138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788839873.655967:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17113:1875734060808192:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788839873.656184:0:17113:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788839873.656484:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17113:1875734060808320:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788839873.656557:0:17113:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788839873.656587:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab744455540 going to sleep for 11 seconds 00000100:00100000:0.0:1788839873.657226:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060808320 00000100:00100000:0.0:1788839873.657235:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060808320 00000100:00100000:0.0:1788839873.657294:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788839873.657304:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17113:x1875734060808320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788839873.657478:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17113:x1875734060808320:12345-0@lo:1000:mdt00_000.0 Request processed in 175us (920us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788839873.657486:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788839873.657843:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6480f4700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17113:1875734060808320:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788839873.657884:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657895:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657903:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657908:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab647958200 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.657913:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657921:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657936:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:2.0:1788839873.657940:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839873.657944:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657950:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.657990:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658007:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658014:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658019:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab75e553600 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.658023:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658029:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658039:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839873.658042:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788839873.658048:0:17113:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658059:0:17113:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658067:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.658134:0:17113:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6400/0xad5b343a26574419 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74d87 expref: 18 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.658160:0:17113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060808448:192.168.203.52@tcp:105: 00000100:00100000:2.0:1788839873.658421:0:17113:0:(client.c:2715:ptlrpc_set_wait()) set ffff8ab760b4a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788839873.665703:0:17113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d4a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17113:1875734060808448:192.168.203.52@tcp:105: 00010000:00010000:2.0:1788839873.665732:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665743:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab75e553600/0xad5b343a26574412 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17115 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665815:0:17113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665830:0:17113:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665842:0:17113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665854:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665860:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665867:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665873:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.665877:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665898:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665911:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839873.665914:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788839873.665918:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665924:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744c1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665936:0:17113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665942:0:17113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665947:0:17113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665952:0:17113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68c00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:2.0:1788839873.665955:0:17113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665961:0:17113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665969:0:17113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:2.0:1788839873.665972:0:17113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788839873.665975:0:17113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.665992:0:17113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68c00/0xad5b343a265744b3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17113 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788839873.666452:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+18:15712:x1875734050253184:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 35476us (35688us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1788839873.666462:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000020:00080000:2.0:1788839873.666468:0:17113:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788839873.666959:0:17150:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788839873.666965:0:17150:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839873.666980:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788839873.666986:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788839873.667268:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.667837:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050253568 00000100:00100000:2.0:1788839873.667846:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050253568 00000100:00100000:2.0:1788839873.667888:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1788839873.667898:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+18:15711:x1875734050253568:12345-192.168.203.52@tcp:49:bash.0 00000100:00100000:2.0:1788839873.668367:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+18:15711:x1875734050253568:12345-192.168.203.52@tcp:49:bash.0 Request processed in 469us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839873.668376:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1788839873.669043:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.669419:0:17117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050253824 00000100:00100000:2.0:1788839873.669426:0:17117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050253824 00000100:00100000:2.0:1788839873.669520:0:17117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1788839873.669529:0:17117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb9a0095-2d97-404b-912c-8b552d60d900+18:15712:x1875734050253824:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788839873.669819:0:17117:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788839873.669851:0:17117:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788839873.669884:0:17117:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.669899:0:17117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.669910:0:17117:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.669932:0:17117:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.669939:0:17117:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.669945:0:17117:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.669957:0:17117:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788839873.670065:0:17117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb9a0095-2d97-404b-912c-8b552d60d900+20:15712:x1875734050253824:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 536us (1021us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788839873.670080:0:17117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000020:00080000:2.0:1788839873.670085:0:17117:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788839873.671323:0:18648:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788839873.671335:0:18648:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.671344:0:18648:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab777de6600 already unused, calling callback (ffffffffc0d8d420) 00010000:00010000:0.0:1788839873.671348:0:18648:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.671358:0:18648:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.671373:0:18648:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab7750d2700) 00010000:00010000:0.0:1788839873.671376:0:18648:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788839873.671380:0:18648:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.671386:0:18648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6600/0xad5b343a265744c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17117 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.671402:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839873.671404:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788839873.671405:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788839873.673083:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.673838:0:19600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050253952 00000100:00100000:0.0:1788839873.673850:0:19600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050253952 00000100:00100000:0.0:1788839873.673916:0:19600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1788839873.673927:0:19600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb9a0095-2d97-404b-912c-8b552d60d900+7:15711:x1875734050253952:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1788839873.673966:0:19600:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788839873.674010:0:19600:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014aaf2ab/0xad5b343a265744cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74dbf expref: -99 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788839873.674037:0:19600:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f87c0, atime: 0x6a9f87be, ctime: 0x6a9f87c0, blocks: 0x0 00010000:00010000:0.0:1788839873.674061:0:19600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788839873.674066:0:19600:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788839873.674084:0:19600:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014aaf2ab/0xad5b343a265744cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dbf expref: 8 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.674102:0:19600:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000014aaf2ab/0xad5b343a265744cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dbf expref: 8 pid: 19600 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.674115:0:19600:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab781e69800, rc 0) 00000100:00100000:0.0:1788839873.674173:0:19600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb9a0095-2d97-404b-912c-8b552d60d900+8:15711:x1875734050253952:12345-192.168.203.52@tcp:101:bash.0 Request processed in 249us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839873.674181:0:19600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1788839873.683571:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.683815:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050254080 00000100:00100000:1.0:1788839873.683826:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050254080 00000100:00100000:1.0:1788839873.683898:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:1.0:1788839873.683908:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+20:15711:x1875734050254080:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1788839873.683949:0:17149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788839873.683969:0:17149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265744d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74dc6 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.684531:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744dd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.684545:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.684556:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744dd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.684683:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647959e00/0xad5b343a265744d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dc6 expref: 22 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.684907:0:17149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab647958200/0xad5b343a265744dd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dc6 expref: 21 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788839873.684917:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:1.0:1788839873.684920:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788839873.684924:0:17149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab647958200, rc 0) 00000100:00100000:1.0:1788839873.685042:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+21:15711:x1875734050254080:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1134us (1479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839873.685049:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1788839873.694111:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839873.698207:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050254336 00000100:00100000:1.0:1788839873.698224:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050254336 00000100:00100000:1.0:1788839873.698293:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1788839873.698304:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+21:15711:x1875734050254336:12345-192.168.203.52@tcp:35:bash.0 00000001:00080000:1.0:1788839873.698604:0:17116:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:1.0:1788839873.698734:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+23:15711:x1875734050254336:12345-192.168.203.52@tcp:35:bash.0 Request processed in 432us (4631us total) trans 8589934632 rc 0/0 00000100:00100000:1.0:1788839873.698743:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000020:00080000:1.0:1788839873.698748:0:17116:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788839873.802047:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.802149:0:17115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050254592 00000100:00100000:2.0:1788839873.802160:0:17115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050254592 00000100:00100000:2.0:1788839873.802235:0:17115:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1788839873.802246:0:17115:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+23:15722:x1875734050254592:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1788839873.802270:0:17115:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788839873.802290:0:17115:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x31f80aa579e74dcd expref: -99 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788839873.802397:0:17115:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788839873.802633:0:17115:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dcd expref: 25 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.802654:0:17115:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab646802600) 00010000:00010000:2.0:1788839873.802658:0:17115:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788839873.802677:0:17115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab777de6e00/0xad5b343a265744e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0x31f80aa579e74dcd expref: 25 pid: 17115 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788839873.802692:0:17115:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab777de6e00, rc 0) 00000100:00100000:2.0:1788839873.802754:0:17115:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb9a0095-2d97-404b-912c-8b552d60d900+24:15722:x1875734050254592:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 510us (717us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1788839873.802762:0:17115:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1788839873.808890:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1788839873.808981:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050254720 00000100:00100000:0.0:1788839873.808992:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050254720 00000100:00100000:0.0:1788839873.809054:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1788839873.809065:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+24:15722:x1875734050254720:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1788839873.809139:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809168:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809179:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809206:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809215:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809224:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809298:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809307:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.809314:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788839873.810466:0:17149:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810492:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810579:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810610:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810617:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69a00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839873.810621:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810638:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810652:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab646802b00) 00010000:00010000:0.0:1788839873.810655:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839873.810659:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810665:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69a00/0xad5b343a265744f2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810678:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810684:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810689:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810694:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e69e00 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839873.810697:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810713:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810721:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab647853b00) 00010000:00010000:0.0:1788839873.810723:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839873.810726:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810733:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e69e00/0xad5b343a265744f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810748:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810754:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810760:0:17149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810765:0:17149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab781e68800 already unused, calling callback (ffffffffc19974f0) 00010000:00010000:0.0:1788839873.810918:0:17149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810927:0:17149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810935:0:17149:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab646802800) 00010000:00010000:0.0:1788839873.810937:0:17149:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788839873.810939:0:17149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788839873.810953:0:17149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab781e68800/0xad5b343a26574500 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788839873.811050:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb9a0095-2d97-404b-912c-8b552d60d900+24:15722:x1875734050254720:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1984us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839873.811059:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:1.0:1788839873.819199:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1788839873.819357:0:17116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050254976 00000100:00100000:2.0:1788839873.819377:0:17116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050254976 00000100:00100000:2.0:1788839873.819441:0:17116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788839873.819452:0:17116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+24:15722:x1875734050254976:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1788839873.819984:0:17116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:15722:x1875734050254976:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 532us (801us total) trans 8589934634 rc 0/0 00000100:00100000:2.0:1788839873.819994:0:17116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1788839873.919662:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788839873.919689:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060808576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788839873.919757:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839873.919916:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060808704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788839873.919942:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788839873.919972:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060808576 00000100:00100000:0.0:1788839873.919979:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060808576 00000100:00100000:0.0:1788839873.920012:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060808704 00000100:00100000:0.0:1788839873.920014:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060808704 00000100:00100000:0.0:1788839873.920027:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788839873.920034:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060808576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788839873.920065:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788839873.920099:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060808576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839873.920106:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788839873.920120:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839873.920125:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060808704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788839873.920140:0:17119:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1788839873.920165:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab641aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875734060808704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788839873.920171:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788839873.920202:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875734060808704:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788839873.920338:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab641aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060808576:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788839873.983011:0:17102:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788839874.728438:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728482:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728529:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728558:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728579:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728601:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728636:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728685:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1788839874.728714:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255360 00000100:00100000:1.0:1788839874.728722:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255360 00000100:00100000:1.0:1788839874.728795:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255872 00000100:00100000:1.0:1788839874.728799:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255872 00000100:00100000:1.0:1788839874.728816:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255232 00000100:00100000:1.0:1788839874.728818:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255232 00000100:00100000:1.0:1788839874.728864:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255744 00000100:00100000:1.0:1788839874.728868:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255744 00000100:00100000:1.0:1788839874.728886:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1788839874.728897:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+5:2391:x1875734050255360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.728967:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+5:2391:x1875734050255360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.728974:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1788839874.728998:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788839874.729004:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2391:x1875734050255872:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.729032:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2391:x1875734050255872:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.729037:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1788839874.729050:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788839874.729056:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:2391:x1875734050255232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.729085:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb9a0095-2d97-404b-912c-8b552d60d900+25:2391:x1875734050255232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.729091:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1788839874.729121:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788839874.729128:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2391:x1875734050255744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.729153:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5247e572-2edf-4a2d-83f4-3e72ae063b75+6:2391:x1875734050255744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.729158:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1788839874.729176:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255616 00000100:00100000:1.0:1788839874.729914:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255616 00000100:00100000:1.0:1788839874.729958:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256128 00000100:00100000:1.0:1788839874.729962:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256128 00000100:00100000:1.0:1788839874.729976:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255488 00000100:00100000:1.0:1788839874.729979:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255488 00000100:00100000:1.0:1788839874.729991:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050256000 00000100:00100000:1.0:1788839874.729993:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050256000 00000100:00100000:1.0:1788839874.730013:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788839874.730021:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2391:x1875734050255616:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.730059:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+5:2391:x1875734050255616:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.730071:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1788839874.730081:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788839874.730090:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2391:x1875734050256128:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.730110:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab6480f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2391:x1875734050256128:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.730114:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1788839874.730121:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788839874.730125:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+8:2391:x1875734050255488:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.730138:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb9a0095-2d97-404b-912c-8b552d60d900+8:2391:x1875734050255488:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 13us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.730141:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1788839874.730147:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1788839874.730150:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2391:x1875734050256000:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1788839874.730162:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7819b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5247e572-2edf-4a2d-83f4-3e72ae063b75+5:2391:x1875734050256000:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 12us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788839874.730166:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00080000:1.0:1788839874.730193:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788839874.730198:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788839874.730200:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788839874.730203:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839874.730567:0:17108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734050255104 00000100:00100000:2.0:1788839874.730574:0:17108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734050255104 00000100:00100000:2.0:1788839874.730605:0:17108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788839874.730613:0:17108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab780019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:2391:x1875734050255104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1788839874.730651:0:17108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab780019050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccda0330-6550-4161-8186-8c642452683e+13:2391:x1875734050255104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 39us (2222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.730658:0:17108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1788839874.943089:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788839874.943112:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060808832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839874.943183:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.943232:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060808832 00000100:00100000:2.0:1788839874.943240:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060808832 00000100:00100000:2.0:1788839874.943286:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839874.943294:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060808832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788839874.943323:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788839874.943363:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777d4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875734060808832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.943371:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788839874.943416:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875734060808832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788839874.944407:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060808960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839874.944446:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944467:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060809472:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944489:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944520:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060809984:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944540:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944559:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060810496:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944580:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944599:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788839874.944605:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060809088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944652:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060809600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944674:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944700:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060810112:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944719:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944745:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab6478adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060809344:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944767:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944803:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060809856:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944823:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944838:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060810368:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944857:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944868:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788839874.944873:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060809216:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944905:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944926:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060809728:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944943:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944957:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060810240:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.944977:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788839874.944997:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809472 00000100:00100000:2.0:1788839874.945003:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809472 00000100:00100000:2.0:1788839874.945030:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809984 00000100:00100000:2.0:1788839874.945038:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809984 00000100:00100000:2.0:1788839874.945051:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810496 00000100:00100000:2.0:1788839874.945053:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810496 00000100:00100000:2.0:1788839874.945074:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810112 00000100:00100000:2.0:1788839874.945076:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810112 00000100:00100000:2.0:1788839874.945086:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810368 00000100:00100000:2.0:1788839874.945088:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810368 00000100:00100000:2.0:1788839874.945099:0:17113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810240 00000100:00100000:2.0:1788839874.945101:0:17113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810240 00000100:00100000:2.0:1788839874.945115:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839874.945130:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060809472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945174:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875734060809472:12345-0@lo:400:kworker.0 Request processed in 44us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945181:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788839874.945196:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839874.945202:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060809984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945226:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875734060809984:12345-0@lo:400:kworker.0 Request processed in 25us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945232:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788839874.945243:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788839874.945248:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060810496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945275:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875734060810496:12345-0@lo:400:kworker.0 Request processed in 26us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945280:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788839874.945290:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788839874.945296:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060810112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945319:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875734060810112:12345-0@lo:400:kworker.0 Request processed in 23us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945324:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788839874.945334:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788839874.945340:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060810368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945368:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875734060810368:12345-0@lo:400:kworker.0 Request processed in 29us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945373:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788839874.945382:0:17113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788839874.945394:0:17113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060810240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945420:0:17113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875734060810240:12345-0@lo:400:kworker.0 Request processed in 26us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945425:0:17113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788839874.945446:0:17105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809088 00000100:00100000:2.0:1788839874.945450:0:17105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809088 00000100:00100000:2.0:1788839874.945470:0:17105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788839874.945475:0:17105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab78001b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3616:x1875734060809088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945511:0:17105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab78001b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4b73860-6950-4a5d-8d03-52a643e5ff43+24:3616:x1875734060809088:12345-0@lo:400:kworker.0 Request processed in 26us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945518:0:17105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788839874.945542:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809600 00000100:00100000:2.0:1788839874.945545:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809600 00000100:00100000:2.0:1788839874.945566:0:17119:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809216 00000100:00100000:2.0:1788839874.945569:0:17119:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809216 00000100:00100000:2.0:1788839874.945579:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839874.945584:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060809600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945613:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060809600:12345-0@lo:400:kworker.0 Request processed in 29us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945619:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788839874.945630:0:17119:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839874.945635:0:17119:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060809216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945658:0:17119:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060809216:12345-0@lo:400:kworker.0 Request processed in 22us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945663:0:17119:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788839874.945682:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809344 00000100:00100000:2.0:1788839874.945685:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809344 00000100:00100000:2.0:1788839874.945713:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809856 00000100:00100000:2.0:1788839874.945716:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809856 00000100:00100000:2.0:1788839874.945731:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060809728 00000100:00100000:2.0:1788839874.945733:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060809728 00000100:00100000:2.0:1788839874.945746:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839874.945751:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060809344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945798:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875734060809344:12345-0@lo:400:kworker.0 Request processed in 47us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945804:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839874.945815:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839874.945820:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060809856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945844:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab777c34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060809856:12345-0@lo:400:kworker.0 Request processed in 25us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945849:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788839874.945858:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788839874.945864:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060809728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.945888:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab648266a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875734060809728:12345-0@lo:400:kworker.0 Request processed in 24us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.945893:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788839874.945915:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788839874.945918:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788839874.945920:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788839874.945922:0:17109:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788839874.945941:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060808960 00000100:00100000:2.0:1788839874.945944:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060808960 00000100:00100000:2.0:1788839874.945965:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839874.945970:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab781a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060808960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788839874.945989:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788839874.946024:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab781a19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875734060808960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788839874.946029:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788839874.946070:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060809216:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946082:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060809728:0@lo:400:kworker.0 00010000:00080000:2.0:1788839874.946095:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab777caad80 x1875734060810240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839874.946105:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875734060810240:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946116:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875734060809344:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946124:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875734060809856:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946132:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875734060810368:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946172:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4b73860-6950-4a5d-8d03-52a643e5ff43:3616:1875734060809088:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946182:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060809600:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946190:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875734060810112:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946202:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab777d48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875734060808960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788839874.946212:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab6478aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875734060809472:0@lo:400:kworker.0 00000100:00100000:2.0:1788839874.946220:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab7819fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875734060809984:0@lo:400:kworker.0 00010000:00080000:2.0:1788839874.946229:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8ab781a1ad80 x1875734060810496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788839890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788839874.946237:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875734060810496:0@lo:400:kworker.0 00000100:00100000:3.0:1788839874.949464:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788839874.949486:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8ab781a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060810624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788839874.949560:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788839874.949602:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875734060810624 00000100:00100000:3.0:1788839874.949609:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875734060810624 00000100:00100000:3.0:1788839874.949651:0:18624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839874.949660:0:18624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab7450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060810624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788839874.949683:0:18624:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788839874.949726:0:18624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab7450d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875734060810624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788839874.949733:0:18624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788839874.949795:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8ab781a4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875734060810624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788839875.006939:0:17101:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788839875.329158:0:20292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000040:00080000:3.0:1788839875.710970:0:17150:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788839875.710979:0:17150:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788839875.711001:0:17150:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788839875.711012:0:17150:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788839876.034149:0:18648:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42589 lines, 42589 kept, 0 dropped, 0 bad.